Skip to content

Research: KiroCrew durable agent runtime, Memory V2 and independent verifier gates (kill-first) #159

Open

Description

@PhysShell

Classification

Objective

Review specific reusable contracts from KiroCrew, not a proposal to replace the current agent harness. Source review (18–21 Nov 2026) confirms repository docs, specs, GitHub workflow structure, not an independently executed system. Separate documented mechanisms from tested behavioral guarantees.

KiroCrew combines persistent ACP sessions, scheduled work, checkpoints, Memory V2 and opt-in apps. Most valuable candidates for 007 are:

  1. Durable task transitions and recovery: identity of task/attempt/action, checkpoint consistency, resume after gateway interruption, explicit cancelled/blocked states.
  2. External deterministic verifier gates: Auto-Improvement uses calibrated measurement + deterministic keep/revert + draft PR rather than allowing proposing model to certify its own patch. Source: auto-improvement spec.
  3. Two-stage independent PR review: high-recall discovery → independent grounded validation; reviewer prompt read from base commit, no PR-side prompt rewriting. Source: claude-review.yml.
  4. Agent memory as proposed derived context: source/provenance, correction history, repo scopes, lesson origin, immutable facts versus inferred suggestions; memory must not become policy. Source: Memory V2 docs.
  5. Cheap monitoring without unnecessary LLM turns: poll PR/check status deterministically; wake model only when actionable change exists, with time/token/error budgets. Source: PR monitoring.
  6. Fix-loop/SZZ analytics with LLM narrative separate from numbers: deterministic metrics cannot be overwritten by summarization; source: fix-loop-analysis.yml.

Strict ownership / avoid overlapping work

Kill-first experiment (proposal, not a command to run)

Stage A: desk audit of current 007 capabilities against the source mechanisms and explicit ADOPT / ADAPT / REJECT / EXISTING / UNKNOWN matrix. For every claimed KiroCrew guarantee, identify implementation + test, or keep UNKNOWN. Record commit hashes and note ACP harness parity gaps (Nov 13 matrix).

Stage B, only if Stage A shows a concrete gap: isolated synthetic repository with deterministic tool, fixed test suite, no production credentials:

  • Baseline 007 multi-step task with independent verifier, checkpoint, forced interruption and resume.
  • Duplicate delivery of one side-effect invocation ID; ensure no duplicated mutation.
  • Failed test / ambiguous tool completion / unknown model token accounting; verify failure remains visible.
  • Optional comparable KiroCrew run only when permissions, model/provider, data and cost conditions are equivalent. Otherwise mark NON-COMPARABLE.

Record: task/attempt/action IDs, log/artifact references, replay proof, duplicate side effects, human approvals, failed gates, total wall-clock, model usage (known/unknown), overhead. Fail-closed vs resume-from-stale-state is a first-class outcome.

Acceptance

Non-goals

No autonomous self-modification, no release/merge, no unreviewed tools on source repos, no storing secrets/production transcripts, no claim that a Python-focused Auto-Improvement app directly works on Go/C#.

Activity

  1. PhysShell commented on Nov 21, 2026

    @PhysShell
    OwnerAuthor

    Addendum / Clare Liguori: Kiro unified harness + reactive agents (21.11.2026)

    Source-backed reference: research Page, Kiro unified harness engineering article, MCP Events incubation repo, talk archive.

    Net-new distinction vs KiroCrew: Kiro unified its separate IDE (TS), CLI (Rust), and web (Python) harnesses, because permissions/session/compaction semantics diverged; it uses a capability-oriented Cedar policy instead of individual per-tool command matchers. Reference pattern: one agent-loop contract, multiple frontends, capability policy, typed tool outcomes and independent verifier. Avoid claiming that Kiro's operational results are proven for 007.

    Reactive agents provide a useful lifecycle question, not an adoption recommendation: suspend → external event → authorize → resume, with durable task/attempt/action identity, duplicate/out-of-order events, cancellation and fail-closed UNKNOWN. MCP Events is an experimental incubation; the repo currently labels Events Beta, not stable core MCP. Names/transport guarantees must be verified against a pinned revision before a wire-level PoC.

    Ownership remains #42 action evidence / #43 persisted event reducer / #57 in-process loop. This issue adds prior art and desk-audit questions only. 007 is PARKED as product; no implementation, migration or autonomous runs authorized. If #42/#43/#57 already cover the required invariants, mark NO-CHANGE.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions