Skip to content

test(console): add e2e smoke and docs - #271

Merged
delete-cloud merged 1 commit into
mainfrom
codex/developer-console-g63-e2e-docs
May 20, 2026
Merged

delete-cloud merged 1 commit into
mainfrom
codex/developer-console-g63-e2e-docs

Conversation

@delete-cloud

@delete-cloud delete-cloud commented May 20, 2026 •

Copy link
Copy Markdown
Owner

Summary

  • add final Developer Console E2E smoke covering runtime, HITL, tape/context, memory, actions, observability, release, navigation, and no-leak assertions
  • add Developer Console usage guide
  • add final implementation report and update G63 goal ledger

Verification

  • uv run pytest tests/ui/test_developer_console.py -v
  • uv run pytest tests/integration/test_durable_runtime_smoke.py -v
  • uv run pytest tests/coding_agent/test_context_system_smoke.py -v
  • uv run pytest tests/coding_agent/action_safety/test_safe_action_smoke.py -v
  • uv run pytest tests/coding_agent/test_observability.py tests/coding_agent/test_observability_local_stack.py tests/coding_agent/test_release_observability_contract.py -v
  • uv run pytest tests/coding_agent/evaluation/ -v
  • uv run pytest tests/agentkit/runtime/test_pipeline.py -k "build_context or runtime_stage_spans" -v
  • uv run ruff format --check tests/ui/test_developer_console.py
  • uv run ruff check tests/ui/test_developer_console.py
  • git diff --check -- .

Summary by CodeRabbit

  • Documentation

    • Updated goal progress tracking reflecting recent merges.
    • Added Developer Console usage guide detailing available debug pages and privacy/safety constraints.
    • Added implementation report documenting the read-only Debug UI architecture and test coverage.
  • Tests

    • Added end-to-end smoke tests covering Developer Console routes and security validations.

Review Change Stack

@delete-cloud
delete-cloud merged commit 7bb7bf7 into main May 20, 2026
1 check was pending
@delete-cloud
delete-cloud deleted the codex/developer-console-g63-e2e-docs branch May 20, 2026 10:48
@coderabbitai

coderabbitai Bot commented May 20, 2026 •

Copy link
Copy Markdown
Contributor

Caution

Review failed

The pull request is closed.

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro Plus

Run ID: a4227135-35f2-429f-b0fd-c3bf215f0cd5

📥 Commits

Reviewing files that changed from the base of the PR and between 8000a6e and 45ae25a.

📒 Files selected for processing (4)
  • coding-agent/docs/developer_console/GOAL_PROGRESS.md
  • coding-agent/docs/developer_console/IMPLEMENTATION_REPORT.md
  • coding-agent/docs/developer_console/USAGE.md
  • coding-agent/tests/ui/test_developer_console.py

📝 Walkthrough

Walkthrough

This PR documents and tests the completed Developer Console feature. It updates goal-progress tracking for G62 (merged) and G63 (smoke/docs work), adds user-facing usage documentation, provides implementation scope and audit coverage details, and introduces an end-to-end smoke test that validates console pages return HTTP 200 with expected content while redacting sensitive strings.

Changes

Developer Console Documentation & Test Coverage

Layer / File(s) Summary
Goal progress tracking for G62/G63
coding-agent/docs/developer_console/GOAL_PROGRESS.md
G62 status updated to merged via PR #270; G63 section added with verification commands, stop criteria, changed files, test results, and remaining risks confirming smoke/docs focus with no new runtime behavior.
Developer Console usage guide
coding-agent/docs/developer_console/USAGE.md
Describes how to start the Coding Agent server and access the Developer Console, enumerates console pages and their purposes (sessions, runs, run detail, HITL interactions, tape, context, memory, actions, observability, release), and documents privacy/safety constraints prohibiting rendering of actions, approvals, secrets, model outputs, and command/environment details.
Implementation scope and audit coverage
coding-agent/docs/developer_console/IMPLEMENTATION_REPORT.md
Documents the read-only console's scope (durable runtime, context, memory, action-safety, observability, release data without core semantics changes), maps goals G54–G63 to PRs, lists console routes, records acceptance audit coverage for durable runtime/context/action/HITL/observability paths, provides pytest verification commands, and identifies remaining risks around historical data, read-only enforcement, and conditional link rendering.
E2E smoke test fixture and navigation test
coding-agent/tests/ui/test_developer_console.py
Helper function _configure_console_e2e_fixture seeds console test runtime with completed run, message snapshot, runtime events, and approval interactions; test function test_developer_console_e2e_smoke_covers_debug_chain monkeypatches observability config and navigates across /console/... routes, asserting HTTP 200, expected page labels, and absence of forbidden-rendered-text strings.

Possibly related PRs

Estimated code review effort

🎯 2 (Simple) | ⏱️ ~12 minutes

Poem

🐰 The console now shines with docs so bright,
E2E tests ensure all pages are right,
G62 merged, G63 done with care,
A read-only debug view, secure and fair!

✨ Finishing Touches
📝 Generate docstrings
  • Create stacked PR
  • Commit on current branch
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch codex/developer-console-g63-e2e-docs

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant