Repository navigation
Track implementation outcomes back into RESEARCH.md - #27
Merged
Merged
Conversation
Closes #25 Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
dmccoystephenson
left a comment
Member
Author
There was a problem hiding this comment.
Self-review rubric:
- Scope: PASS — only
CLAUDE.md(1 line) andRESEARCH.md(15 lines across 4 places) modified; all changes implement #25's AC #1–#3 directly. - Tests-new: PASS — the convention introduced is prose; the three retroactive Implementations entries demonstrate the format being applied, making the convention self-exemplifying.
- Tests-fix: N/A — not a bug fix.
- Sibling structure: PASS — new How-to-use bullet follows the same
**When ...** — ...shape as its three neighbors; Implementations subsections all use the same**Implementations.**\n- PR #N (summary): shipped DATE. Observed effect: ...shape. - Sibling renames: N/A — no identifiers renamed.
- Docs: PASS — Phase 7 sources of truth for this repo are
create-dev-loop.mdandREADME.md; neither changed because this PR adds a process rule to RESEARCH.md/CLAUDE.md (themselves Phase 7 sources for the project, both updated together to keep them in sync). - Issue resolution: PARTIAL but transparent — AC #1, #2, #3 met; AC #4 ('at least one updated outcome entry not just pending') explicitly deferred in the PR body since outcomes require multi-cycle data that doesn't yet exist. Calling this PASS-with-noted-deferral rather than FAIL because the AC is structurally impossible to satisfy in the same PR that introduces the tracking.
- Validation: PASS —
grep -n '^\*\*Implementations\.'confirms the three entries land under §1, §4, §5;gh pr view 15 --json mergedAtconfirmed PR #15 ship date. - Placeholder-consistency: N/A — no template change.
- Escaping: N/A — the fenced code block added to RESEARCH.md is not inside the
create-dev-loop.mdouter markdown template; it's free-standing in RESEARCH.md, so no triple-backtick escape needed.
Adversarial probe: 'Should Implementations also appear in the Adding-a-new-finding template at the bottom of RESEARCH.md?' Considered and rejected — that template is for new findings, which by definition have no implementations yet; adding a blank subsection would be noise. Leaving as-is is consistent with the issue's 'optional subsection' framing.
6 tasks done
dmccoystephenson
pushed a commit
that referenced
this pull request
May 25, 2026
The Phase 1 skip-reason and Phase 2 tiebreaker changes implement findings §2 (agent-PR merge-rate gradient) and §7 (LLM triage as filter not decision-maker), so per the CLAUDE.md rule shipped in PR #27, both findings get Implementations entries pointing at this PR. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
dmccoystephenson
added a commit
that referenced
this pull request
May 25, 2026
* Bias triage and batching toward higher-merge-rate issue types Closes #20 Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * Record Implementations entries for RESEARCH.md §2 and §7 The Phase 1 skip-reason and Phase 2 tiebreaker changes implement findings §2 (agent-PR merge-rate gradient) and §7 (LLM triage as filter not decision-maker), so per the CLAUDE.md rule shipped in PR #27, both findings get Implementations entries pointing at this PR. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> --------- Co-authored-by: BuildTools <unconfigured@null.spigotmc.org> Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
This was referenced May 25, 2026
dmccoystephenson
added a commit
that referenced
this pull request
Aug 3, 2026
Closes #25 Co-authored-by: BuildTools <unconfigured@null.spigotmc.org> Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
dmccoystephenson
added a commit
that referenced
this pull request
Aug 3, 2026
* Bias triage and batching toward higher-merge-rate issue types Closes #20 Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * Record Implementations entries for RESEARCH.md §2 and §7 The Phase 1 skip-reason and Phase 2 tiebreaker changes implement findings §2 (agent-PR merge-rate gradient) and §7 (LLM triage as filter not decision-maker), so per the CLAUDE.md rule shipped in PR #27, both findings get Implementations entries pointing at this PR. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> --------- Co-authored-by: BuildTools <unconfigured@null.spigotmc.org> Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Closes the feedback loop between research-grounded predictions and what we actually observe by:
Closes #Nbefore push) — a narrow instance of "re-state scope at boundaries"The "observed effect" column starts at "pending" — replacing it with real numbers requires running multiple cycles, which only becomes routine once #24 (structured self-audit) lands. This PR establishes the data-recording habit so the column has somewhere to go.
Closes #25
Test plan
grep -n "^\*\*Implementations\." RESEARCH.mdreturning lines 44/104/124 (one per finding)create-dev-loop.mdtemplate; substitution table unchangedgh pr view 15 --json mergedAtgh issue view 25and confirmed issue title/body match this PR's workNote on AC #4
Issue #25's fourth AC ("at least one updated outcome entry, i.e. not just 'pending'") cannot be honestly satisfied yet — none of the three implementations has been measured across enough cycles to replace "pending" with a real observation. Marking that AC explicitly as deferred rather than fabricating an outcome.
drafted by Claude on behalf of Daniel Stephenson