Skip to content

docs: demo prep — code memory for code mode agents on cloudflare artifacts - #3

Merged
smithclay merged 6 commits into
mainfrom
demo-prep
Oct 12, 2026
Merged

smithclay merged 6 commits into
mainfrom
demo-prep

Conversation

@smithclay

@smithclay smithclay commented Oct 12, 2026 •

Copy link
Copy Markdown
Owner

Prep for the Build the Next-Gen Git Platform competition (closes Oct 14, 11:59 PM PDT).

Thesis

Code memory for Code Mode agents, on Cloudflare Artifacts. Throw away the isolate, keep the code. The video lands this as a one-two punch:

  1. Code Mode: models write code better than they call tools, and that code is "a compact plan" (Cloudflare's words). Each plan runs in a disposable isolate, so it's thrown away after the run.
  2. Code memory:
    • Phase 1: every execution is saved to the agent's own Artifacts repo.
    • Phase 2: Workers AI embeddings and Vectorize let the next agent start from the closest code others already ran.

The script opens with an alice→bob walkthrough on the example's catalog, then uses DABstep as the deep dive.

Changes

  • DEMO.md: an 8-minute run of show built around the thesis. It opens on the learning curve, then covers durable Code Mode, memory at fleet scale (the swarm), learning from memory, which kind of memory works (raw runs vs distilled skills), results, and use plus what's next. Each beat maps to a judging criterion and has a draft voiceover, plus an asset checklist and pre-flight list.
  • Learning curve: benchmarks/dabstep/scripts/learning_curve.py and a new section in docs/experiments.md, computed from Adyen's official per-task scores.
    • Tasks 1–8, with no memory yet: both arms use about 315–320k median tokens.
    • Tasks 25–48: 45k vs 215k.
    • Tasks 97–450: 60k vs 186k.
    • Accuracy is 11–19 points higher in every fifth of the run.
  • docs/submission.md: draft answers for every field on the submission form, with the vision rewritten around the thesis.
  • examples/agent/scripts/swarm.mjs: the concurrency burst. It starts N agents at once (one Durable Object, one repo, one commit each) and reports commits/s and p50/p95 latency.
  • Example cleanup: drops the snippets endpoint and updates the catalog comment.
  • README: leads with the thesis and documents the swarm script.

Verification

  • npm run typecheck and npm test pass.
  • The swarm script ran against a local mock server: 100 agents, with injected failures counted as errors.
  • It has not run against Artifacts yet. That's the next step, before Oct 15 when Artifacts billing starts. Its numbers fill in the bracketed placeholders in the script.

- scripts/swarm.mjs runs N agents concurrently (one Durable Object, one
  repo, one commit each) and reports commits/s and p50/p95 latencies.
- Remove GET /agents/:name/snippets: snippets are no longer part of the design.
- Update the catalog comment to point at examples retrieval.
- DEMO.md: an 8-minute run of show mapped to the judging criteria, with
  presentation principles, an asset checklist and the swarm burst.
- docs/submission.md: draft answers for the submission form.
- README: document the swarm script.
… as memory

- DEMO.md: new thesis and run of show. Phase 1 makes Code Mode durable
  (every execution is a commit); phase 2 learns from it. Headless git, not
  a reimagined GitHub UI.
- docs/experiments.md + scripts/learning_curve.py: learning curve by run
  position from the official per-task scores. The cold start costs the same
  as baseline; median tokens fall to about a third within ~25 tasks.
- docs/submission.md: rewrite the project vision.
- README: lead with the thesis.
@smithclay smithclay changed the title docs: demo prep — video script, submission draft, swarm burst docs: demo prep — self-improving code mode agents, swarm burst, submission draft Oct 12, 2026
…e artifacts

- DEMO.md: open with an alice→bob walkthrough on the catalog, explain Code
  Mode in Cloudflare's own terms (a compact plan, run in a disposable
  isolate), then code memory on Artifacts and learning with Workers AI and
  Vectorize, with DABstep as the deep dive. Artifacts-first vocabulary.
- docs/submission.md and README: same positioning and tagline.
@smithclay smithclay changed the title docs: demo prep — self-improving code mode agents, swarm burst, submission draft docs: demo prep — code memory for code mode agents on cloudflare artifacts Oct 12, 2026
…p wall

- lamps connector: a deterministic 10×10 wall (7 wax colors; flowing,
  warming or off; hours on), paginated 12 per page with filters for row,
  wax and status. It stands in for the LavaRand wall in Cloudflare's SF lobby.
- swarm.mjs and the README example count flowing lamps across every page.
- DEMO.md: lava lamp cold open and the alice→bob walkthrough (67 flowing;
  10 red flowing across 2 pages).
@smithclay
smithclay added this pull request to stack #6 October 12, 2026 23:17
@smithclay
smithclay merged commit ad73c36 into main Oct 12, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant