Repository navigation
Reduce CI queueing and repeated security review test work - #746
Merged
Merged
Conversation
Merged
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Closes #725.
Evidence
cargo test --test security_review invalid_or_missing_final_lines_hold_self_merge_but_report_only_runs_continue -- --exact --nocaptureexercised 22 Runs in 72.42 s on this Linux host.After: the same command exercises four representative Runs in 12.28 s; all 11 malformed cases (plus missing
None) pass in process in <0.01 s. Compilation is excluded from these test durations.After: a second push at 03:36:03 UTC cancelled queued macOS work at 03:36:04, released the active Linux test runner at 03:36:42, and released the active Linux artifact runner at 03:37:04. Superseded CI and Release both concluded cancelled. The macOS aggregate rejected the cancelled shards.
cargo test, all macOS shards and aggregate, both release artifacts, Rocky Linux and WSL smoke checks. PR publication jobs stayed skipped.Measured macOS job timings in seconds, baseline main run vs the successor CI run. Start delay is workflow creation to runner start, including startup and any concurrency wait; execution includes setup/build/tests.
These are observations from different hosted runs, not a controlled queue benchmark or a promised savings percentage. The baseline slowest shard's nextest execution was 916.842 s, with the unauthenticated publisher matrix at 306.951 s; this run measured 763.643 s and 244.253 s respectively. That process/credential matrix remains end to end. The final-message table measured 158.687 s → 31.166 s on macOS, alongside the targeted Linux measurement above. Further performance work stays linked to #570 and the completed #174 baseline, without assuming those old targets describe this host.
Release's macOS artifact waited 724 s from workflow creation and executed in 192 s. Linux CI executed in 552 s. No live tag was created for this experiment: GitHub's
@actions/expressions0.3.61 evaluated the actual concurrency expressions for repeated PR heads, different PRs/fork branch names, main and tags. PR groups are stable per workflow/PR; non-PR groups include run IDs to preserve even pending publications. YAML-parsed Release jobs and tag triggers compare equal tomain.Validation:
cargo check --all-targets,cargo fmt --check,cargo clippy --all-targets -- -D warnings: passed.cargo nextest run --no-fail-fast --status-level slow --final-status-level all: 1,768 passed, 2 intentionally skipped, 916.006 s; security validator tests: 65 passed.python3 -m unittest discover -s scripts -p 'test_*.py'and actualpython3 scripts/generate-release.py --checknow pass, including stale-output detection and restoration after generator failure.[]. The factory and release script wait for available checks/runs without requiring Release by name. Thus docs/site/test-only PRs can skip Release without stranding a current required check. Revisit this contract before making Release mandatory for every PR. Generator ownership and policy are documented indocs/ci-performance.md.Test seams
Review::from_final_message→Outcome: every original malformed case and the public hold/entry contract.Review
Independent Standards and Spec reviews used
main(a9e2d5353812ec3a6d6caefaa0c72838d79cfeb2) as the fixed point. Standards' duplicated concurrency policy finding was addressed by making CI the single authored definition. Spec's pending hosted-measurement finding was reproduced with its exact command, then resolved with successful successor runs and the recorded measurements. Both axes read all 12 changed files; no changed file was left unread.Unaddressed findings
a9e2d5353812ec3a6d6caefaa0c72838d79cfeb2covered the diff and supporting release/delivery code. Sandboxed local checks passed for the generator CLI fixture, malformed-message unit matrix, and retained four-Run end-to-end matrix.Security review outcome
No unaddressed introduced findings.
Merge Danger
Door: two-way
Workflow/config/test changes can be reverted; artifact targets and publication policy are preserved. The customized workflow uses cargo-dist's documented
allow-dirty = ["ci"]support and replaces its skipped freshness check with the complete generator check in CI.Blast Radius: CI
Path selection depends on the current package inputs and required-check contract; update it when either changes.
Built with codex · gpt-6.1-sol · high