Skip to content

feat(engine): schema envelope, streaming telemetry, and verification gates - #529

Merged
JohnnyWilson16 merged 5 commits into
mainfrom
feat/ci-verification-gates
Oct 22, 2026
Merged

JohnnyWilson16 merged 5 commits into
mainfrom
feat/ci-verification-gates

Conversation

@JohnnyWilson16

Copy link
Copy Markdown
Contributor

Summary

  • Schema Preservation & Execution Layer:
    • Implements SchemaEnvelope for lossless capture/restoration of extension dtypes, MultiIndex hierarchies, and non-monotonic index orders across Polars and DuckDB bridges.
    • Adds PandasEngine, PolarsEngine, and DuckDBEngine with row-survivorship index tracking, defensive unhashable object handling, and Polars streaming engine telemetry.
    • Adds imputation.py with finite-safe float64 matrix extraction, KNN imputation with correlation weighting, and identifier guards.
    • Updates api.py and __init__.py to expose clean, pipeline, plan, and apply.
  • Packaging & CI Configuration:
    • Updates pyproject.toml and adds MANIFEST.in.
    • Adds .github/workflows/ci-verification-gates.yml cross-engine parity matrix with --no-cov guardrails and branch coverage gates.
  • Verification Suites & Benchmarks:
    • Adds full test suites across extension dtypes, degenerate frames/indices, hostile object columns, streaming telemetry, README claims, and Hypothesis property invariants.
    • Adds artifact audit script (scripts/audit_artifacts.py), mutation testing audit (scripts/run_mutmut_audit.py), ground truth benchmark (benchmarks/run_ground_truth_bench.py), and scale profiling benchmark (benchmarks/run_scale_profile.py).

Verification Results

  • Unit & Parity Suite: 20 passed
  • Branch Coverage: 90.57% (exceeds 90% threshold)
  • Artifact Audit: Clean-room isolated wheel & sdist smoke test passed
  • Mutation Testing: 100% killed (36/36 mutants)
  • Ground Truth & Scale Benchmarks: Passed

@coderabbitai

coderabbitai Bot commented Oct 21, 2026 •

Copy link
Copy Markdown
Contributor

Important

  • 🔍 Trigger review

This repository does not receive automatic reviews because it has fewer than 10 stars.

⚙️ Run configuration
  • Configuration used: defaults
  • Review profile: CHILL
  • Plan: Advanced
  • Run ID: 05c06c1b-3efc-47f4-adb3-3899a6116336
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@coderabbitai

coderabbitai Bot commented Oct 21, 2026

Copy link
Copy Markdown
Contributor

Add Carrot credits or activate Agent usage billing to use Autofix

@JohnnyWilson16
JohnnyWilson16 merged commit 5d9669e into main Oct 22, 2026
11 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant