Skip to content

Ship Cloudflare security-audit as a Factory skill - #553

Merged
JacobStephens2 merged 1 commit into
issue-427from
issue-537
Oct 8, 2026
Merged

JacobStephens2 merged 1 commit into
issue-427from
issue-537

Conversation

@JacobStephens2

@JacobStephens2 JacobStephens2 commented Oct 8, 2026 •

Copy link
Copy Markdown
Owner

Summary

Ships Cloudflare's pinned security-audit skill through the existing Factory skill embedding and worktree links. Regenerates the Prompts and skills page and adds Cloudflare's licence and README credits.

skills/thirdshift-security-audit/
├── SKILL.md + 19 supporting files  # c1c8a8c; only frontmatter name adapted
├── LICENSE                        # Cloudflare MIT
└── CREDITS.md                     # upstream repository and full commit

Closes #537

Evidence

  • Before: cargo test --test fresh_run ships_cloudflares_security_audit_with_its_license_and_provenance_on_both_harnesses failed: the session found no thirdshift-security-audit.
    After: the same test passes for Claude Code and Codex, including supporting files, licence, provenance, and clean git status.
  • Before: cargo test --bin thirdshift prompts_page_shows_cloudflares_security_audit_and_its_mit_license failed: the Factory skill had no page usage entry.
    After: the test and all 9 page checks pass; regenerated with UPDATE_PROMPTS=1 cargo test prompts_page.
  • Independent GitHub tree/blob comparison: all 20 skill files and LICENSE match c1c8a8c1471069fb0e188eeaff69b8e8db6564a8, normalizing only the frontmatter name. The Spec reviewer also decoded all 22 generated skill-file blocks and compared them with their sources.
  • Focused test files: fresh_run 21 passed, codex_sessions 12 passed, packaging 5 passed. All 65 imported validator tests pass.
  • cargo check, cargo fmt --check, and cargo clippy --all-targets -- -D warnings pass. Full cargo test passes (foreground run exited 0). Linux and macOS CI and both release artifact builds pass.

Seams under test

  • The end-to-end scenario harness: the real binary, real git, and fake Harness CLIs observe the embedded skill and supporting files through worktree links, with those links excluded from git.
  • The Prompts and skills page: the generated page lists the Factory skill, its upstream provenance, and Cloudflare's MIT licence.
  • The existing crates.io package manifest: shipped skill files include their licence and credits.

Unaddressed findings

Standards

  • S1 — Possible duplicated code: skills/thirdshift-security-audit/validate-findings.cjs:62,139,466,600 and validate-coverage-ledger.cjs:103,321,382,725 duplicate helpers. Declined for this import: The security-audit skill ships as a Factory skill #537 requires files to match upstream except for the name; skills/thirdshift-security-audit/CREDITS.md:5 records that plan decision, and independent blob verification passed. Extracting shared helpers changes the required upstream files. Future upstream cleanup is tracked for the Day shift in #554; changing the pin or allowing additional adaptations requires a Day shift decision.
  • S2 — Implementation-coupled upstream test: skills/thirdshift-security-audit/validate-findings.test.cjs:584–585 compares regex source and flags. Ran the reviewer's exact scratch-copy command: reordering a regex character class caused exit 1 with PATH_FORBIDDEN_CHARACTER source. The unchanged alignment test passes (1 test). The refactor experiment confirms the test-design concern; removing upstream assertions would violate The security-audit skill ships as a Factory skill #537's pinned-copy requirement and CREDITS.md:5. The Day shift’s decision about an upstream fix or a new pin is tracked in #554.

Spec

None.

Changed files unread: none on either axis; each reviewer read all 28 changed files.

Merge Danger

Door: two-way

Reverting removes the imported assets and their page and credits entries.

Blast Radius: Skills

Built with codex · gpt-6.1-sol · xhigh

@JacobStephens2
JacobStephens2 marked this pull request as ready for review October 8, 2026 04:13
@JacobStephens2
JacobStephens2 merged commit 2ddf4b7 into issue-427 Oct 8, 2026
13 checks passed
@JacobStephens2
JacobStephens2 deleted the issue-537 branch October 8, 2026 04:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant