Repository navigation
Flaky tests under full-suite load + Docker-dependent tests need skip guard #582
Description
Problem
When running the full test suite (~177 test files, ~4989 tests), approximately 24 tests fail intermittently due to two unrelated categories:
1. Docker-dependent tests (~15 failures)
Tests in \ est/cli/init.test.ts\ and \ est/init-prompt.test.ts\ require Docker Desktop to be running. When Docker is not available, they fail with:
\
failed to connect to the docker API at npipe:////./pipe/dockerDesktopLinuxEngine
\\
Suggested fix: Add a skip guard that checks for Docker availability before running these tests (e.g., \describe.skipIf(!dockerAvailable)).
2. Timing/flaky tests under resource contention (~9 failures)
Tests in \ est/speed-gates.test.ts, \ est/streams.test.ts, \ est/template-sync.test.ts, \ est/repl-ux-fixes.test.ts, and \ est/human-journeys.test.ts\ fail when the full suite runs with 22 parallel workers but pass individually when run in isolation.
Symptoms:
- Vitest worker timeout errors (\Timeout calling onTaskUpdate)
- \ENOTEMPTY: directory not empty, rmdir\ during test cleanup
- Timing assertions fail under load (speed gates)
Suggested fix: Increase timeout margins for speed-gate tests, add retry for cleanup operations, or reduce parallelism for resource-sensitive test files.
Impact
These are pre-existing on dev/main — not introduced by any specific PR. They affect CI reliability and cause false negatives in PR checks.
Environment
- Windows 11, Node.js 20+
- Vitest with 22 parallel workers
- Docker Desktop not always running
squad obo dina
Activity
bradygaster commentedon Mar 24, 2026
formatting issues again
github-actions commentedon Mar 24, 2026
📋 Assigned to FIDO (Quality Owner)
Issue: #582 — Flaky tests under full-suite load + Docker-dependent tests need skip guard
FIDO will pick this up in the next Copilot session.
github-actions commentedon Mar 24, 2026
🏗️ Squad Triage — Flight (Lead)
Issue: #582 — Flaky tests under full-suite load + Docker-dependent tests need skip guard
Assigned to: FIDO (Quality Owner)
Reason: Issue relates to testing/quality work
@copilot evaluation: 🔴 Not suitable — issue involves work outside the coding agent's capability profile.
Team roster:
squad:flightsquad:proceduressquad:eecomsquad:fidosquad:paosquad:capcomsquad:controlsquad:surgeonsquad:boostersquad:gncsquad:networksquad:retrosquad:incosquad:guidosquad:telemetrysquad:voxsquad:dskysquad:simssquad:handbooksquad:ralphsquad:copilotdocs(ai-team): Aspire investigation complete — logging and decision m…
fix: address PR github#582 review feedback
fix: address remaining PR github#582 feedback
chore: team updates — risk assessment, PR github#582 plan, README audit
Merge PR github#582: Consult mode implementation
chore(kobayashi): document PR github#582 merge execution
docs(ai-team): PR github#582 merge complete, decisions merged, team s…
Merge pull request github#582 from jsturtevant/consult-mode-impl
chore: Kobayashi intervention — charter guardrails + history corrections
docs(kobayashi): check off final checklist item — origin/migration pu…
Merge migration into main for v0.8.18 release
fix(test): add shared Docker skip guard helper + increase template-sy…
diberry commentedon Mar 31, 2026
🔄 Ralph status: Closing as duplicate of #677, which was filed specifically to fix this issue. PR #679 addresses both. Tracking continues on #677.
fix(test): add shared Docker skip guard helper + increase template-sy…
fix(test): add shared Docker skip guard helper + increase template-sy…
fix(test): Docker skip guards + flaky test stabilization (#677)
fix(test): Docker skip guards + flaky test stabilization (#677)
fix(test): add shared Docker skip guard helper + increase template-sy…