Skip to content

Grill #1252 and #1253: the Bar's pass and fail levels - #1269

Merged
JacobStephens2 merged 1 commit into
mainfrom
grill-1252-1253
Oct 24, 2026
Merged

JacobStephens2 merged 1 commit into
mainfrom
grill-1252-1253

Conversation

@JacobStephens2

Copy link
Copy Markdown
Owner

Summary

Records the grill-with-docs session that turned #1252 into a Spec and #1253 into one of its Tickets. Docs only.

 docs/grill-with-docs/
+└── 1252-1253-bar-and-rechecks.md   # Rounds 1–4, the settled decisions, simulations and sources
 GLOSSARY.md
   **Bar**
-    the margin, the credible level, the prior, …
+    the margin, the pass level and the fail level (the credible levels a pass and a fail are each judged at), the prior, …

The decision: a pass is judged at a looser pass level against the −10 margin, while a fail stays at the 95% fail level against zero. The default pass level is set from an A/A Experiment. The Tickets are #1264–#1268 and #1253, all under #1252.

Evidence

Merge Danger

Door: two-way

Blast Radius: docs

The glossary now names the Bar's two levels ahead of the code on issue-977, which still has one credible level until #1264. If #977's Spec PR also edits the Bar entry, the two will conflict on that line.

@JacobStephens2
JacobStephens2 merged commit 5dd66ca into main Oct 24, 2026
6 checks passed
@JacobStephens2
JacobStephens2 deleted the grill-1252-1253 branch October 24, 2026 16:27
This was referenced Oct 24, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant