Repository navigation
Evidence-backed review findings - #496
Merged
Merged
Conversation
Share review instruction across Session prompts
Require evidence for correctness findings and declines
…g to fix on the branch) 2026-10-07T06:49:26Z, host thirdshift. Uncommitted work at the time of failure is included in this commit.
2026-10-07T11:59:05Z, host thirdshift. Uncommitted work at the time of failure is included in this commit.
Track reviewer file coverage and retry unread files once
Keep reviewer reports beside Session logs
JacobStephens2
marked this pull request as ready for review
October 7, 2026 13:15
…g to fix on the branch) 2026-10-07T13:45:17Z, host thirdshift. Uncommitted work at the time of failure is included in this commit.
JacobStephens2
marked this pull request as draft
October 7, 2026 13:45
JacobStephens2
marked this pull request as ready for review
October 7, 2026 14:47
Merged
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Closes #486
Every Session that runs the code review now uses the same evidence, decline, and coverage rules: fresh and Continuation implement Sessions, the Spec review, and the Repair that reviews Foreign commits.
Spec findings keep quoting requirements; Standards findings keep citing standards or naming smells. Written-out evidence and files-read lists sit outside the expanded prose limit. A passing run supports a decline only when it exercises that particular finding. Each decline cites a line of code, plan decision, ADR, or that run. Calls left to a Spec or the Day shift link an existing open issue or create one carrying only
needs-triage, with the finding, evidence, originating PR, and reason for the decision. Remaining unread changed files are named in the review and PR body.Sessions supplies report paths on every Harness and retains whichever reports exist under the Session log's name with
.standardsand.specextensions, including after a failed Session. Missing reports and setup or retention errors produce progress lines and preserve the Session outcome. Generated prompts, the prompts page, andCONTEXT.mddescribe the same contract. The final Standards review also consolidated duplicated execution-test setup.Evidence
mainasks authors to address findings they agree with and give skipped findings a one-line reason; it has no shared reviewer-report retention.After: The generated prompts/page checks verify the evidence, decline, coverage, and report-path instructions. Execution tests verify opaque report retention across all six Harnesses, Resume retention, failed-Session retention, and continuation when reports are missing or setup fails.
f3a0302repeats the review execution fixture setup in the normal path and the report-setup failure regression.After: Both use one helper; the existing behavior assertions remain intact.
Validation:
cargo teston the reviewed headf3a0302: 1,431 passed, 1 existing ignored test.cargo test --bin thirdshift session::execution_tests: all 9 passed.cargo fmt --check,cargo clippy --all-targets -- -D warnings, andgit diff --check: passed after the refactor.Seams under test
Sessions::within, with fake Harness CLIs and observable prompts, retained reports, progress, and Run outcomes.The skill's text was reviewed directly, as #486 specifies.
Unaddressed findings
Standards
None. The single finding, duplicated execution-test setup, was addressed.
Spec
None. The review checked #486 as a whole, including the integration of all four Tickets.
Both reviewers read every changed file; none remain unread.
Files read by both Standards and Spec reviewers
Merge Danger
Door: two-way
The review instructions and report storage can be reverted without a data migration.
Blast Radius: Sessions
The review contract applies to implement Sessions, Spec reviews, and Foreign-commit Repairs on every Harness. thirdshift keeps reports without interpreting them or gating delivery on findings; Failed-run rules, the Repair loop, the Claim, and the Self-merge retain their existing behavior.
Tickets
Built with codex · gpt-6.1-sol · xhigh