Repository navigation
Count Unaddressed findings by kind in Run metrics - #1146
Merged
Merged
Conversation
This was referenced Oct 23, 2026
Merged
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Completed Runs retain separate Standards, Spec and Security counts in
run_metrics.unaddressed_findings.A body without the section records zeros; no PR records null. An unreadable body preserves a known Security review count with null Standards and Spec counts.
Closes #1034
Evidence
cargo test --test run_metrics a_run_counts_unaddressed_findings_by_kind_from_its_final_pr_body -- --exactfailed: null instead of{standards: 2, spec: 1, security: 1}.After: passed; coverage also checks final-body edits by Repairs, later Day shift edits, bodies without the section, no PR, older records, Spec runs and Ticket Runs.
After: both exact commands passed, with their regression tests retained:
cargo test --test run_metrics spec_review_nested_evidence_heading_preserves_the_findings_axis -- --exactcargo test --test security_review spec_review_known_security_count_survives_an_unreadable_pr_body -- --exactcargo test --test security_review run_metrics_include_the_security_reviews_count_even_if_its_body_write_fails -- --exactfailed before the fix and passed after it.cargo fmt -- --checkandcargo clippy --all-targets -- -D warningspassed.13b0cdb; the duplicate local run was stopped after CI passed. After merging the advanced Base branch,cargo check,cargo test --test run_metrics --test review_summary_resume_repro, the Security body-read regression and formatting passed on68614d0.scripts/affected-tests issue-981: all 44 local site tests passed. Reused the successful full Rust CI run on exact final head68614d0, followingdocs/testing.md; stopped the duplicate local Rust run after CI passed. CI'scargo teststep took 12m 19s, including compilation and excluding queue time. The same run passed formatting, Clippy, release-generator checks, site and Console browser tests.Test seams
gh: completed Runs retain Unaddressed findings by kind, andshow --jsonreturns those retained metrics.Review coverage
thirdshift-code-reviewreviewed againstissue-981, initially pinned fromorigin/issue-981at0767f7c9e6f5bd9dff185bfd52eeed825d08e1d6. Both axes read all 14 implementation files and inspected the fixes through13b0cdb, including generated HTML directly. Generated-output exclusions: none.The Base branch then advanced through #1144 / #1035. Merge commit
68614d0preserves its per-session review counts alongside this PR's Unaddressed findings. The implementing agent inspected and tested the resolutions. Each independent reviewer had already used its one permitted follow-up; the following changed files have final merge hunks left unread by both axes:The merge also imports these Base-branch revisions, outside the current PR diff, which these reviewers did not inspect after reconciliation:
Standards: 0 findings. Spec: 2 P2 findings, both reproduced and fixed; 0 outstanding.
Merge Danger
Door: two-way
Blast Radius: Observability
Adds a completion-time PR-body read and retained metrics. Read failures warn and preserve any independently known Security count.
Unaddressed findings
Standards
None.
Spec
None. Both Spec findings were addressed; no findings were skipped or deferred to the Day shift.
Security
None. The Security review of the issue-1034 change against merge base 371e40a found no introduced Security findings, so nothing is unaddressed. The new code only counts Delivery's own PR-body entries into retained metrics: it takes no privileged action on the counts, keeps the independently recorded Security review count with max() so body edits cannot suppress it, and parses with a linear line scan with no regex, no dynamic execution, no secrets, and no new network or file writes. No proof-of-concept test failed, so no fix was committed. Evidence: cargo test --test run_metrics (8 passed), --test security_review (39 passed), --bin thirdshift pull_request:: (32 passed) and delivery:: (68 passed); cargo fmt --check and cargo clippy --all-targets -- -D warnings clean.
Built with codex · gpt-6.1-sol · xhigh
Security review outcome
No unaddressed introduced findings.