Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
18 changes: 9 additions & 9 deletions evaluation/standards-effectiveness/generated/suite-inputs.json
Original file line number Diff line number Diff line change
Expand Up @@ -7347,7 +7347,7 @@
]
},
{
"digest": "sha256:8d8859b36d951bbf7a747da81d597df19b07b6653f1e36acc48b4b131b90c0a8",
"digest": "sha256:142cffd188781617e4641812e2f9bd33b99edf7bbbbd1d54e613bbcbcc8864a2",
"path": "tools/standards_engine/README.md",
"state": "present",
"uses": [
Expand Down Expand Up @@ -7405,7 +7405,7 @@
]
},
{
"digest": "sha256:489fea805dbfd6f84bcb28374b467da192d56243100c0a58d568d9acf6180e08",
"digest": "sha256:146231132e8fbff19b5d917c1268bb75a0195cff4478d0e44df6bf04b8ba6aa2",
"path": "tools/standards_engine/contracts/examples/a1-examples.json",
"state": "present",
"uses": [
Expand Down Expand Up @@ -7661,7 +7661,7 @@
]
},
{
"digest": "sha256:bc14652d3aa78ea400495d7f89fe9c4662c4de16acf759cac41d8279239a2a78",
"digest": "sha256:1a6d59145f4b8d43c67c23787fc450b60b569bbd65089fca9e6817b17848edae",
"path": "tools/standards_engine/standards_engine/interaction_observer.py",
"state": "present",
"uses": [
Expand All @@ -7685,7 +7685,7 @@
]
},
{
"digest": "sha256:899c6bb6605a9b6e07bee7992c48120f3dd10fe2a8bf77fa9d20a35a3575ab22",
"digest": "sha256:49b9ba34111d7fff7dfb575ec3e7e29d8d2be259ab35ba03bd7af26feb5b8c89",
"path": "tools/standards_engine/standards_engine/mcp.py",
"state": "present",
"uses": [
Expand Down Expand Up @@ -7875,7 +7875,7 @@
]
},
{
"digest": "sha256:7f51e403f03f5c57be8b1ca5736a79bcf139c87dd9eb4703ce3f7e59f1ba3d01",
"digest": "sha256:30eec6a6c472938048821b5669d17e054aa7cdee637647961b4012a380245e62",
"path": "tools/standards_engine/tests/test_analysis.py",
"state": "present",
"uses": [
Expand All @@ -7887,7 +7887,7 @@
]
},
{
"digest": "sha256:2a5e6761f159c63e3c79f8fed0d90e1edcf987ea78a86fc9878a2866c840ef03",
"digest": "sha256:bcb26ee92ec9e34ca2e04280c9122f43a81a515dd195b73d53dc864d55649e06",
"path": "tools/standards_engine/tests/test_coverage_publication.py",
"state": "present",
"uses": [
Expand Down Expand Up @@ -8344,7 +8344,7 @@
]
},
{
"digest": "sha256:828be47647e4332067893b79a508e85ed65ff1d524c41daf8f09fa41f6b7d2a2",
"digest": "sha256:e6f3adf5543fad7cbd24b31b68b21d08029e542e11d80d2899d30b2ced682452",
"path": "tools/standards_snapshots/README.md",
"state": "present",
"uses": [
Expand Down Expand Up @@ -8441,7 +8441,7 @@
]
},
{
"digest": "sha256:bda178630b8226af0de5c42a7da6290ace2ed1745e3d2a99057deb0bae6ac617",
"digest": "sha256:6853039f09ef90b9d4ba9f54e4df7050b13b0a1941764af95250b44f7237ecae",
"path": "tools/standards_snapshots/standards_snapshots/store.py",
"state": "present",
"uses": [
Expand Down Expand Up @@ -14116,7 +14116,7 @@
"path": "evaluation/standards-effectiveness/suite-registry.toml"
},
"repository_index": {
"digest": "sha256:25f5d13e9650e10c5bcc198f50ea81aa00f90799ca3f9ba2a5a433a658262229",
"digest": "sha256:96dd89639c5b1a45d6c6692e969cea93338efdd3e5604fb2c2d30e6cfe254fd7",
"uses": [
{
"check": "python-package-contract",
Expand Down
460 changes: 280 additions & 180 deletions tools/standards_engine/MCP-OBSERVABILITY.md

Large diffs are not rendered by default.

16 changes: 11 additions & 5 deletions tools/standards_engine/PURPOSE-SEPARATION.md
Original file line number Diff line number Diff line change
Expand Up @@ -124,9 +124,14 @@ two-entry and 32 MiB accounted-retention limit shared by snapshot and draft
projection entries. Snapshot keys contain the exact verified
captured paths, bytes and source revision, plus the installed compiler function.
Python dictionary equality distinguishes hash collisions. Each new operation
opens and validates its store, checks snapshot lifecycle and verifies complete
content identity before lookup. Missing, quarantined, purged, replaced or corrupt
storage therefore remains observable. Equal verified inputs may share pure
opens its store, checks its application, version and exact schema, checks snapshot
lifecycle and verifies complete content identity before lookup. Missing,
quarantined, purged or replaced storage, and content that no longer matches its
identity, therefore remain observable. The store's complete SQLite
integrity/foreign-key audit is not repeated by every operation: a process runs it
on its first open of a store file, as described under
[Snapshot admission](../standards_snapshots/README.md#admission-and-maintenance-work).
Equal verified inputs may share pure
compilation even when obtained from distinct store roots; store-specific handles,
access checks and result envelopes remain fresh. No store facts enter the cache.

Expand Down Expand Up @@ -185,8 +190,9 @@ Review, candidate verification, application and recovery retain their existing
fresh replay paths. New snapshot capture retains both independent compiler passes.
Main advancement affects new captures, never the base of an existing draft. Old
explicit revisions retain historical meaning and can have live stale status.
Corruption, quarantine, purge or missing/replaced stores reject before projection
reuse. Server restart reconstructs cold, and close releases both entry kinds.
Stored content that fails validation, quarantine, purge or missing/replaced stores
reject before projection reuse. Server restart reconstructs cold and repeats the
store's complete SQLite audit; close releases both entry kinds.

### Incremental successor construction

Expand Down
26 changes: 20 additions & 6 deletions tools/standards_engine/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -38,10 +38,13 @@ normative text, policy subjects, consumer relationships and other certificates
remain intact. It supplies no replacement coverage claim. Restart/reconnect
after installing the coordinated source and generated contracts; preserve stores.

Optional sanitized operator measurements use `--observe-database` with
`--observe-deployment`; see [MCP observability](MCP-OBSERVABILITY.md). Recording is
disabled by default and preserves the existing qualification observer v3 and
agent-visible interface. This is the sole supported MCP recorder.
Every MCP server process records how its tools are used in an operator-only local
SQLite file and keeps about seven days. See
[MCP interaction recording](MCP-OBSERVABILITY.md) for exactly what is and is not
recorded, where the file is, and how to turn it off (`--no-observe` or
`STANDARDS_ENGINE_OBSERVE=off`). Recording changes nothing an agent can see and
preserves the existing qualification observer v3. This is the sole supported MCP
recorder.

## Purpose separation (interface 31)

Expand Down Expand Up @@ -336,6 +339,10 @@ The process-owned compilation cache also retains exact captured-content identity
proofs. Identity and compilation for one capture share one LRU entry and the existing
byte budget. The Snapshot codec still defines identity, and every read reloads actual
bytes, verifies file integrity and checks the stored identity and current lifecycle.
These per-read checks are separate from the store's complete SQLite
integrity/foreign-key audit, which a process runs on its first open of a store file
and not on each store-backed call; see
[Snapshot admission](../standards_snapshots/README.md#admission-and-maintenance-work).

Focused authoring operations reuse canonical revision decoding through
`ProposalMaterials`; the single record is released on success or exceptional exit.
Expand Down Expand Up @@ -420,8 +427,15 @@ after installation without changing launch arguments or deleting stores.
The earlier raw invocation recorder was retired on 2026-10-22. Its
`--observation-db` launch option is no longer accepted. Historical raw databases
remain operator-owned evidence and are not converted, reused or deleted.
Select a new dedicated database with `--observe-database` and a nonsensitive
`--observe-deployment` label. Follow the [sanitized recorder's operating contract](MCP-OBSERVABILITY.md)

The opt-in sanitized recorder that replaced it (schema v1, selected with
`--observe-database` and `--observe-deployment`) is in turn replaced by always-on
recording in a new default file (schema v2). Its v1 databases are also left
untouched. A registration that still names a v1 file with `--observe-database`
is refused that file and records nothing until the option is removed; remove both
options to use the default location. `--observe-database` now only overrides the
location and `--observe-deployment` defaults to `local`. Follow the
[recording contract](MCP-OBSERVABILITY.md)
for permissions, retained data, retention and reports. The
[original observation plan](../../docs/plans/agent-interaction-observation/plan.md)
retains its historical acceptance and qualification records.
4 changes: 2 additions & 2 deletions tools/standards_engine/contracts/examples/a1-examples.json
Original file line number Diff line number Diff line change
Expand Up @@ -1274,7 +1274,7 @@
"value": {
"kind": "input-contract-result",
"purpose": "application",
"interface_version": 47,
"interface_version": 48,
"catalog_digest": "sha256:aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa",
"operation": "runtime_info",
"root": "RuntimeInfoCall",
Expand Down Expand Up @@ -1420,7 +1420,7 @@
"value": {
"kind": "output-contract-result",
"purpose": "authoring",
"interface_version": 47,
"interface_version": 48,
"catalog_digest": "sha256:aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa",
"operation": "review",
"dialect": "https://json-schema.org/draft/2020-12/schema",
Expand Down
Loading
Loading