Repository navigation
Add Void Trial, Bar and Verdict, and amend ADRs 0019 and 0016 for #698 - #973
Merged
Merged
Conversation
The glossary gains the last three eval terms #698's grilling settled (Q7.3). Trial now belongs to its Experiment, which is a Command, though a Trial writes no Command record of its own. Command lists the Experiment. ADR 0019 now has each session write two OTLP JSON Lines files, log records and spans, since the format allows one type of data per file (Q5.9). ADR 0016 lets the Console record judgments only a person makes: dismissing an item in Needs you (#919), and for evals, scoring a sampled Run, confirming a Bug origin and approving an Eval task (Q6.9). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01BnFUcJ51dAFoj97E8FSXQF
Merged
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
The decisions from #698's grilling that #943 didn't carry, settled after it was opened.
Glossary (Q7.3), in the Evals section:
ADR 0019 (Q5.9): each session writes two OTLP JSON Lines files, one of log records and one of spans, since the OTLP file format allows one type of data per file. Silent watches the log records' file.
ADR 0016 (Q6.9): the Console may also record judgments only a person makes:
Each is also a CLI command with
--json, and none starts work.The decisions are in
.scratch/grill-with-docs/698-evals/settled.mdandround-7.md. The four Specs coming out of #698 use these terms.No code changes.
🤖 Generated with Claude Code
https://claude.ai/code/session_01BnFUcJ51dAFoj97E8FSXQF