Repository navigation
Add your Scores and criterion calibration - #1282
Merged
Merged
Conversation
This was referenced Oct 24, 2026
Merged
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Closes #1027
Test seams
Evidence
cargo test --test scoring mine_requires_all_five_scores_before_revealing_the_modelfailed on the unsupported CLI; the historical-selection test found zero marked PRs.After: terminal entry, the historical 20, weekly selection, independent rolling calibration and a history exceeding 1,000 PRs pass through the binary against fakes.
After:
cargo test --test scoring grading::scoring_grader_ -- --nocapturepasses both retained regressions. The token regression also checks that the sandbox still receives its real dummy credential.cargo check,cargo fmt --checkandcargo clippy --all-targets -- -D warningspass. All 32 Scoring tests pass. The initial affected-test run found the existing compact-help limit; its unchanged regression passes after combining the Scores forms onto one line.scripts/affected-tests issue-978passes: 2,424 Rust tests, 57 skipped fixture/platform tests, and 43 browser checks. Used nextest with eight test threads: 1,416.714s Rust execution, 26.57s compilation, 1,539.66s for the complete affected-check command including browser checks, measured with/usr/bin/time -p.3c15c2a. An earlier attempt failed while Git cloned a temporary release-test repository;cargo test --test release main_moving_during_a_completed_ci_read_is_followed -- --exactpassed unchanged, and the failed CI job passed on rerun.Merge Danger
Door: two-way
Blast Radius: Scoring
Adds private human Scores and selection metadata to existing checkpoints, with defaults for older records. Includes the #1026 Grader prerequisite in the fixed-point review. No destructive migration.
Unaddressed findings
Standards
src/scoring.rs:295enriches the existing serialized Week/PullRequest schema only at the presentation layer;ScoreandCriterionremain typed insrc/scoring/grader.rs:18. A parallel typed view would duplicate the persisted schema.calibration_requires_twenty_pairs_tracks_eighteen_matches_and_rolls_independentlyexercises each criterion's JSON. The reviewer accepted this implementation decision and withdrew the suggestion.src/proxy.rs:57selects provider hosts,src/sandbox.rs:646provisions credentials, andsrc/sandbox.rs:937chooses mounts according to the binary's filesystem layout. These implement different decisions; combining them would couple distinct operations. The reviewer accepted this implementation decision and withdrew the suggestion.Spec
None. Both privacy findings were reproduced, fixed and retained as regression tests.
Security
None.
Security review outcome
No unaddressed introduced findings.
Review coverage
Independent Standards and Spec reviewers used
issue-978(8905eb4) as the fixed point and reviewed the implementation at5e32972. Each read all 42 changed files, including generated output; no exclusions and no unread changed files at that reviewed head. Standards: three suggestions fixed, two withdrawn. Spec: two findings fixed. Reports, including each axis's final combined files-read list, are saved in.thirdshift-review-Z0yy4R/standards.mdand.thirdshift-review-Z0yy4R/spec.mdbeside the Session evidence.Post-review unread change:
src/main.rs:85was subsequently compacted onto one help line at3c15c2a; this final hunk was not reread by either reviewer. The rest of that file was read. The existinghelp_is_a_compact_reference_with_a_link_to_the_detailsregression passes unchanged. No other final changed file was left unread.Built with codex · gpt-6.1-sol · xhigh