Repository navigation
Description
First cumulative status snapshot. This is a progress summary, not a new RFC, acceptance decision or execution authorization.
1. Snapshot
- Repository: InferMatrixLab/InferRSI.
- Checked: 2026-10-20, 08:38 UTC / 16:38 Shanghai.
- Edition: first, cumulative snapshot. Covers initialization including the root commit through the inspected main head, not only the latest four PRs.
- Initialization:
d7af684, 2026-10-08 01:34 UTC,chore: initialize repository; verified to have no parent commits and no changed files (empty initialization). - Head:
ac702729, 2026-10-20 05:05 UTC, feat: read-only store path and knowledge CLI bridge (#32 PR 2) #39. - Navigation: changes after initialization through head. The root is empty, so this comparison covers the subsequent repository content; initialization itself is included in the narrative.
- Bottom line: the repository has evolved from an initialized scaffold into an agent-assisted inference experiment workbench plus a traceable knowledge layer. It is not yet an autonomous optimizer, and delivered interfaces do not establish skill efficacy or universal hardware gains.
2. What changed: the evolution from init
Dates below describe integration into the repository (UTC), not when every underlying experiment or branch implementation occurred. Stages overlap and are grouped by capability rather than presented as a commit dump.
| Stage | Evolution | Human-facing consequence | Main evidence |
|---|---|---|---|
| Oct 8–11: initialization and scaffold | Repository initialization → portable layout, evidence segments, test/CI conventions and agent entry rules | Teams gain a repeatable starting structure; the design is not yet proof of a working optimizer | root commit; #4–#7 |
| Oct 14: executable workbench | Scaffold/design → CLI experiment execution, supplied benchmark/quality contracts and diffusion knowledge | Baseline/candidate comparisons can produce recorded, scoped evidence rather than narrative-only claims | #2; architecture and campaign guides |
| Oct 15–16: broader knowledge and empirical lessons | Initial repository experience → multi-engine bilingual knowledge, contribution/dependency/peer relationships and detailed positive/negative Drama3 evidence | Agents can find transfer candidates and avoid repeating failed directions; local wins remain separate from service acceptance | #9, #11, #13–#22 (evidence PRs within this range) |
| Oct 16–18: collaboration and KB contracts | Informal coordination and content access → Issue-led responsibility, normalized Reader, revision/dependency handling and authorized candidate Store | Ownership, exact material identity, update history and acceptance boundaries become explicit; maintained interfaces are renamed InferRSI | #21/#23; #17 with #12/#24–#26; rename and scoped-case integration commits |
| Oct 19: downstream delivery and readiness | General workbench/knowledge → engine-delivery scaffold, Drama3 NPU readiness, privacy guidance and Qwen3-TTS source import | Teams get handoff contracts and reusable techniques without turning downstream engines into InferRSI runtime dependencies | #27/#28, #29, #33/#34, #35/#36 |
| Oct 20: agent-facing usability | Python-level normalized knowledge access and mixed entry guidance → three onboarding paths and collect/read/resource CLI with explicit read-only Store access | Less custom glue is needed to find and consume selected material; default-output/install/documentation gaps still require correction | #32 via #37/#39 |
The transition is scaffold → executable experiments → sourced knowledge and lessons → explicit ownership/revisions → easier agent access. Automatic planning, patch generation, efficacy-tested skill selection and automatic experience promotion remain outside the established implementation.
3. Architecture delta
Current architecture, established over this cumulative history: an external human/coding agent drives an experiment workbench and a traceable knowledge layer. The latest usability changes extend access to that architecture rather than replacing it.
flowchart TB
A["Human / external coding agent: goals, diagnosis, patches, permissions"]
A --> K["Knowledge: package / checkout / candidate store"]
A --> W["CLI + RunSpec"]
W --> H["Harness: AB/BA, deadlines, evidence, verdicts"]
H --> M["Model: requests, metrics, quality contracts"]
H --> I["Infra: sources, devices, processes, artifacts"]
M --> I
I --> R["Prepared benchmark / validator / independent engine"]
H --> E["Recorded evidence and reports"]
E -. "Reviewed lessons; separately authorized updates" .-> K
- Evolution across this first edition: the scaffold acquired a concrete Harness/Model/Infra execution path and then a normalized package/checkout/store knowledge surface. The latest step added the knowledge CLI and read-only Store path.
- Current responsibility boundary: the external agent plans and changes code; shared Harness/Model/Infra modules execute and adjudicate supplied experiments. The dashed feedback path is not an automatic learning or promotion loop.
- Retained: Reference Matrix for sources and SearchSpace Matrix for resource × stage coverage. Neither is an automatic task router.
- Ownership: engines keep their runtime in their own repositories. Store Create/Update remain Python APIs for authorized candidates, not edits to package/checkout content.
See the architecture source of truth, rather than duplicating its full module inventory here.
4. Capability status
Delivery, acceptance and validation are deliberately separate.
| Capability / workstream | In main? | Goal acceptance / tracking | What is actually validated? |
|---|---|---|---|
| KB v1 / collaboration / Drama3 NPU readiness | Yes, delivered within this cumulative history | #17, #21, #27 closed | Their scoped contracts and recorded checks; NPU readiness is not a working NPU engine |
| Engine-delivery scaffold | Yes, delivered Oct 19 | #29 open; acceptance remains to be reconciled | Scaffold/recipe checks, not an engine deployment |
| Privacy guidance | Yes, #34 | #33 open | Rules delivered; no claim that historical/downstream leaks are remediated |
| Qwen3-TTS knowledge import | Yes, #36 | #35 open | Source/import evidence; performance remains INCONCLUSIVE |
| Agent Usability v1 | Yes, #37/#39 | #32 closed, but post-closure review found gaps below | PR-head CI passed; clean-install/default-output acceptance is incomplete |
| Campaign Plan | No merged #31 | #30/#31 open | Proposed template, not an integrated capability |
| MLX discovery and knowledge | No landed support confirmed | #38 open | Branch-reported checks do not establish main support or Apple Silicon inference readiness |
| Skill Eval v1 | No | #40 proposed | No pilot result; client, tasks, verifier and authorized budget remain to be settled |
5. Evidence and limitations
Current usability gaps
Static review of ac702729 found three bounded problems:
- Text-mode
collectdrops--materialcontent and may emit nothing for query-only no-match; full JSON preserves the envelope. - Checkout quickstart commands need the
skillsextra/PyYAML, which the base installation step does not supply. - The operation guide misstates legacy search no-match, mandatory
contextfilters and mandatoryresourcerevision.
These require a small corrective change and tests, not a Reader/Store redesign. A local-agent instruction has been prepared; no corrective implementation or PR is confirmed in this snapshot.
Refs: material output finding, install finding, operation-guide findings, successful PR-head CI.
Recorded performance outcomes across the cumulative history
- Qwen-Image B300: historical scoped accepted result, 30.60% lower latency with 44/44 pixel-identical checks; included as historical evidence, not newly reproduced for this report. Acceptance: Qwen-Image-2.1-Turbo / B300×4 campaign #3 remaining open does not negate the recorded result.
- Drama3 B300: per-concurrency target remains INCONCLUSIVE; optimization is recorded as paused. Local kernel/graph gains are not service acceptance.
- Qwen3-TTS import: source-grounded transfer candidates, not accelerator/audio-quality reproduction or per-feature speedup proof.
Recorded campaign results and conditions. This brief uses repository evidence and source inspection; it did not run new benchmarks or independently rerun the full test suite.
6. Next decisions
- Usability acceptance: complete a bounded correction for [RFC] Agent Usability v1: onboarding, knowledge discovery and interface alignment #32, test clean installation and text/JSON outputs, then update acceptance evidence against the final revision.
- Campaign structure: resolve [RFC] Iteration Campaign Plan: one table for model, hardware, goal, search plan and test plan #30/docs: add a campaign plan template for the plan evidence segment #31, keeping plans linked to the existing matrices and allowing justified, budgeted diagnostics.
- Skill efficacy: refine [RFC] Skill Eval v1: revision-scoped discovery and task-efficacy evaluation #40's initial client, tasks/verifier, held-out split and budget before authorizing execution.
Separately, reconcile the already-landed deliverables in #29/#33/#35 with their owners' acceptance criteria. Do not close them solely because a commit merged. MLX remains a parallel, independently scoped workstream.
Activity
Dong1017 commentedon Oct 23, 2026
Status 02 — 2026-10-23 published:
ac70272978965f0043dcc2ead81afb813c69f63c→48e0d5894117be7c57f8b4ce793c0ec986f219e8(38 commits). Covers packaged knowledge, admission/reliability, accepted pilot and newly merged local skill comparisons; PR automation and operational acceptance remain separate. This inspected main head is the base for the next edition.Dong1017 commentedon Oct 31, 2026
Status 03 — 2026-10-31 catch-up for 2026-10-30 published:
48e0d5894117be7c57f8b4ce793c0ec986f219e8→6810870046b4f493d39b6eaede0f1a4004369235(113 commits). Consolidates the prior in-week updates and current acceptance/evidence limits. Actual seven-day comment window: [2026-10-31 14:40:09, 2026-11-07 14:40:09) Asia/Shanghai; no backdated publication. This body SHA is the next edition's baseline.Dong1017 commentedon Nov 6, 2026
Status 04 — 2026-11-06 published. Main
6810870046b4f493d39b6eaede0f1a4004369235→1246348f252dbc7e473efb1752c2d81da15e23fd(31 commits). Comment window [2026-11-06 19:12:55, 2026-11-13 19:12:55) Asia/Shanghai.Dong1017 commentedon Nov 8, 2026
Status 04 — consolidated in-week update, 2026-11-08:
1246348f252dbc7e473efb1752c2d81da15e23fd→3a67f2456156f1071d4821e172a5bb55393f3f08(one commit). Covers merged DSH source, v0.1.5 publication, the recorded architecture decision and scoped downstream campaign evidence; full host acceptance and the C1/C16 target remain open. One current catch-up, not backdated daily reports.Dong1017 commentedon Nov 9, 2026
The "Publication convention" and "Reusable template" sections have moved to #61 Roadmap, "Status reporting", per the owner's decision. #61 is now the report index and template entry point; new edition index comments go there.
This issue keeps the Status 01 snapshot and the existing index comments for editions 02–04 unchanged. The moved text is identical apart from two references: "add a short index comment here" now reads "on this issue" (#61), and the sentence "Historical snapshot content above is unchanged" was dropped because it referred to this body.
The previous body of this issue is preserved in the issue edit history.