Skip to content

Fix missing-observation semantics - #7

Open
altrudev wants to merge 3 commits into
mainfrom
fix/missing-observation-semantics-v2
Open

altrudev wants to merge 3 commits into
mainfrom
fix/missing-observation-semantics-v2

Conversation

@altrudev

Copy link
Copy Markdown
Owner

Purpose

Stop Agent Replay from turning missing observed evidence into a false mismatch, rebased cleanly on the current main including the newer evidence-gap work.

Changes

  • mismatches() compares only fields actually present in observed
  • adds not_observed() so missing key is distinct from explicit JSON null
  • events with expectations but missing observations are UNASSESSED
  • timeline exposes not_observed
  • preserves current evidence_gaps / evidence completeness behavior from main
  • regression tests cover missing observation, explicit-null mismatch, and explicit-null match

Evidence Contract

Implements the first correctness item from #3:

Absence of evidence is not evidence of mismatch.

Verification

Targeted execution of the comparison logic passed the critical semantic cases. Full repository test execution is still unavailable from this ChatGPT runtime because direct GitHub cloning is DNS-blocked; no claim of a full-suite pass is made.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant