FreeCite: A Judge-Free Benchmark for Granular Citation Evaluation in Large Language Models
-
Updated
Feb 22, 2026 - Python
#
deterministic-evaluation
Here are 9 public repositories matching this topic...
As of 07/09/2026 the only open-source PT-PT benchmark that avoids LLM judges and targets email-style structured generation. Deterministic CPU-friendly benchmark for European Portuguese (PT-PT) email LLMs. No LLM judges.
nlp open-source benchmark reproducible email text-generation portuguese dialect pt-pt business-email portuguese-portugal portuguese-european llm-evaluation structured-generation portuguese-nlp llm-benchmark deterministic-evaluation european-portuguese no-llm-judge
-
Updated
Sep 10, 2026 - Python
AI-assisted policy formalization and governance platform for source-traceable rule extraction, human review, immutable versioning, deterministic evaluation, quality analysis, and regression testing.
react rule-engine compliance governance policy-engine policy-as-code fastapi azure-openai azure-ai-search deterministic-evaluation
-
Updated
Sep 2, 2026 - Python
Public, fully local PoCs for counterfactually auditable lifecycle certification: exact paired replay, drift monitoring, post-drift replanning, and bridge-aware ledger control on synthetic tasks.
ai poc autonomous-agents synthetic-data drift-monitoring llm scientific-reproducibility deterministic-evaluation counterfactual-auditing paired-replay
-
Updated
Mar 19, 2026 - Python
Hybrid legal RAG and LLM extraction with JSON Schema rule compilation, three-valued logic, Census/TIGER geocoding, and deterministic evaluation.
python rule-engine hackathon civic-tech explainable-ai rag rental-housing legal-tech large-language-models deterministic-evaluation housing-law
-
Updated
Oct 13, 2026 - Python
Deterministic multi-lane evaluation domain for SnorkelAI Terminus3. Cockpit, lane orchestration, agent benchmarking, reasoning-drift detection.
python docker evaluation terminus snorkel cockpit deterministic multi-lane deterministic-evaluation agent-benchmarking snorkelai terminus3 reasoning-drift multi-lane-evaluation ml-eval
-
Updated
Sep 28, 2026 - Python
SnorkelAI Terminus2 task suite with deterministic evaluators, Dockerized environments, and reproducible agent-benchmarking primitives.
python docker benchmarking evaluation terminus snorkel deterministic deterministic-evaluation agent-benchmarking snorkelai terminus2 task-engineering dockerized-evaluators ml-eval
-
Updated
Jun 17, 2026 - Python
Core deterministic architecture for multi-lane ML evaluation systems. Foundational logic, capsule interfaces, reproducible execution patterns.
python azure architecture evaluation saas deterministic capsule system-design capsules multi-lane container-apps capsule-system trust-engine deterministic-evaluation gravity-binary capsule-integration evaluation-architecture gravitybinary
-
Updated
May 10, 2026 - Python
Deterministic offline ComtradeBench judge for evaluating agent robustness under pagination, retries, duplicates, page drift, and totals traps.
-
Updated
Aug 17, 2026 - Python
Add this topic to your repo
To associate your repository with the deterministic-evaluation topic, visit your repo's landing page and select "manage topics."