Repository navigation
SDK feature parity: 29 features need active exercise testing #340
Description
Summary
Systematic SDK-first feature parity testing in the SdkSquad test bed has identified 29 features that need active exercise testing. These features have correct filesystem setup (configs, templates, routing rules exist) but their runtime behavior hasn't been verified for SDK squads.
This issue tracks the remaining test matrix. Each feature category below needs a dedicated test session.
Test Matrix — Remaining Features
P1: Workflow Features (7 features)
| # | Feature | What to Test |
|---|---|---|
| 19 | Directive capture | Give "Always..." directive → verify inbox capture |
| 20 | Eager execution | Multi-domain task → verify anticipatory spawns |
| 22 | GitHub repo connection | Connect to repo → verify Issue Source in team.md |
| 23 | Issue triage | Label issue squad → verify Lead assigns squad:{member} |
| 24 | Issue lifecycle | Issue → branch → PR → merge flow |
| 25 | Label routing | Apply squad:{name} → verify agent dispatch |
| 29-32 | Ralph (4 features) | Activation, work-check, idle-watch, watch mode |
P2: Advanced Features (12 features)
| # | Feature | What to Test |
|---|---|---|
| 26-28 | Ceremonies (3) | Auto-trigger, manual, cooldown |
| 33-35 | PRD Mode (3) | Intake, decomposition, work routing |
| 36-38 | Human & Copilot (3) | Add human, add @copilot, auto-assign |
| 39-40 | Skills (2) | Agent extraction, confidence lifecycle |
P3: Platform & Edge Cases (9 features)
| # | Feature | What to Test |
|---|---|---|
| 42 | Worktree awareness | Multi-worktree team root resolution |
| 45-46 | Reviewer protocol (2) | Rejection lockout, deadlock escalation |
| 47 | Client compatibility | VS Code mode detection & degradation |
| 48 | MCP integration | Tool discovery, graceful degradation |
| 49 | Constraint budget | Counter display during constrained tasks |
| 50 | Multi-agent artifact | Assembled result + raw appendix format |
Already Verified (this session)
| # | Feature | Status |
|---|---|---|
| 17 | Skill-aware routing | ✅ Verified — skills/ exists with correct format |
| 44 | Merge drivers | ✅ Verified — .gitattributes has merge=union rules |
| 33 | PRD intake | ✅ Partially verified — PRD.md exists, referenced in decisions |
Blocking Issues
- SDK init: Adding team members doesn't update squad.config.ts #337 — Config ↔ team.md sync (blocks Feature: Get squads to use project boards #6, Please Don't Lock
squadinto using GitHub #8, Copilot client parity: Squad works fully only on GitHub Copilot CLI #10) - Ralph missing from config (blocks New team members should leverage configured plugin marketplace #29–VS Code: Test and document runSubagent as Squad spawn mechanism #32) — see companion issue
- @copilot routing without roster (blocks Context window optimization: decisions.md pruning, spawn template dedup, Init Mode compression #37–docs: MCP, notifications, and plugin marketplace guides #38) — see companion issue
Test Bed
- Repo: SdkSquad (Snake game, vanilla JS)
- PRD:
PRD.mdat repo root tracks all 50 features - Squad: Matrix universe (Neo, Tank, Switch, Dozer, Scribe, Ralph)
Exit Criteria
Every feature is either:
- ✅ Verified — tested and confirmed working in SDK squad
- 🚫 Scoped out — explicitly excluded with rationale
No
Activity
github-actions commentedon Mar 10, 2026
🏗️ Squad Triage — Flight (Lead)
Issue: #340 — SDK feature parity: 29 features need active exercise testing
Assigned to: FIDO (Quality Owner)
Reason: Issue relates to testing/quality work
@copilot evaluation: 🔴 Not suitable — issue involves work outside the coding agent's capability profile.
Team roster:
squad:flightsquad:proceduressquad:eecomsquad:fidosquad:paosquad:capcomsquad:controlsquad:surgeonsquad:boostersquad:gncsquad:networksquad:retrosquad:incosquad:guidosquad:telemetrysquad:voxsquad:dskysquad:simssquad:handbooksquad:ralphsquad:copilotbradygaster commentedon Mar 10, 2026
Update: Testing Progress (2026-03-10)
Original filing said 29 features untested. After systematic testing this session:
Before: 18 ✅ | 3 ❌ | 29⚠️ ⚠️
After: 32 ✅ | 6 ❌ | 12
Features verified this session (+14):
Remaining 12 features (need specific test setups):
npx squad watchexercisegit worktree addfor multi-worktreeNew gaps found (+3):
Full PRD with complete matrix: #341
feat: breathtaking first-run wow moment (github#362)
feat: P2 nice-to-haves from Marquez audit (github#364)
github-actions commentedon Mar 13, 2026
squad:hockney. Check.squad/team.md(or.ai-team/team.md) for valid member names.github-actions commentedon Mar 13, 2026
📋 Assigned to FIDO (Quality Owner)
Issue: #340 — SDK feature parity: 29 features need active exercise testing
FIDO will pick this up in the next Copilot session.
test: SDK feature parity tests for #340
test: SDK feature parity tests for #340 (#422)
bradygaster commentedon Mar 15, 2026
Closed via PR #422 (squash-merged to dev). 22 integration tests added for worktree awareness, reviewer lockout, deadlock handling, and skill confidence. 4 manual verification sub-issues created (#418-#421) for prompt-only features.
williamhallatt commentedon Mar 16, 2026
PRs #425 (64 tests) and #428 (46 tests) add 110 tests covering 7 features previously marked as⚠️ Needs Setup in the #341 matrix. Combined with batch 1 (PR #422, 22 tests), automated tests now cover 11 of 13 ⚠️ features — 132 tests total across 3 batches.