Repository navigation
feat(taxonome): integrate taxonomies with Scope - #1597
Draft
Cedric Vidal (cedricvidal) wants to merge 23 commits into
Draft
Cedric Vidal (cedricvidal) wants to merge 23 commits into
Cedric Vidal (cedricvidal) wants to merge 23 commits into
Conversation
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Bound GEPA minibatches to the actual Train corpus so candidate proposals can be evaluated within the metric budget. Surface measured proposal, score, Pareto, and stop signals while preserving plain and JSON output contracts. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Place the two task-oriented guides under Use and design taxonomies, verify desktop and mobile navigation, and make generated code samples keyboard reachable with unique labels. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Allow optimize --in-place to publish a previously selected optimized YAML and its matching provenance manifest without rerunning sampling-managed model selection. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Clip interactive dashboard fields to a fixed physical width so cursor rewrites do not leave stale wrapped rows in terminals and recordings. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Keep every interactive optimization row below 80 columns so cursor updates replace prior state instead of leaving wrapped stale blocks. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Add project-scoped list enrichment and bulk taxonomy detail resolution with bounded revision history and exact ordered element revisions. Expose the same projection through the CLI. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Use shared list/table primitives for taxonomy discovery and add guarded exact-revision detail, history, ordered elements, copy/delete actions, and prompt revision editing with Storybook coverage. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Install system CA certificates in builder and runtime stages so the bundled Copilot CLI can validate token-backed SDK authentication. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Map Portal run composition to canonical Experiment request payloads with workerType, preserving legacy request submission behavior and exact profile variation expansion. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Resolve current and historical Experiment execution vectors into ordered request/run summaries with bounded bulk reads, preserving deleted and missing members. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Integrates Taxonome into Scope as a project-scoped taxonomy product and exact-run Experiment post-processor.
{id}@rNrefs, built-in seeding/copy, YAML import/export, content-SHA integrity, and project isolation.ax-taxonomy@r1.--element-override, and transactional--output-dir/--in-placeoptimization.optimize --from-candidate ... --in-placepromotion so the reviewed YAML used for side-by-side Test evaluation is published atomically without rerunning sampling-managed model selection.scope taxonomy show; no per-row element requests or unrelated global element catalog expansion.requests[].workerTypeJSON, including count/profile-variation expansion, while preserving legacy ordinary run submission.Demos
Two corrected headless recordings were produced locally with real commands and model-backed execution. They remain session artifacts pending separate user review and publication authorization.
Before
N/A — new integration.
After
Media publication is intentionally deferred. Automated Storybook interactions and the Docker/browser smoke cover the active Portal surfaces.
Testing
pnpm --filter taxonomy-engine test— passed, 326 tests.pnpm --filter ax-taxonomy test— passed, 38 tests.pnpm --filter static-prompt-evals test:ts— passed, 41 tests.SITE=https://microsoft.github.io BASE_PATH=/scope pnpm build— passed.0.75, changed candidate1.0, every final Validation row rescored, and candidate-change events observed.1/2, two independent Ax-selected changed candidates each2/2, with the first selected candidate improving Validation from0.75to1.0in 24 bounded metric calls. The sealed Test packet remained unused during development.3/4with one reviewed confirmation false positive; Ax-selected optimized YAML4/4on the identical packet. Exact candidate promotion produced a focused realimplementation.promptdiff and the final run/readout passed.taxonomy showreturned the same six ordered exact element refs as the API detail projection.element@r1 → @r2plustaxonomy@r1 → @r2), and historical selection resolving back to exactelement@r1all passed.coder-acp-copilot@copilot-dev, and verified Submit Run shows GitHub Copilot CLI.ca-certificatesin both stages. A durable image rebuild was attempted but blocked by registryECONNRESET/ENOTCONN; no source/test failure remains.chamomileas the default, and restored Profile creation; a bounded smoke profile was created and soft-deleted.chamomileExperiment create; the smoke Experiment deletion cascade was started afterward.2ae16ba4-6e5e-41fb-be0a-73839111877anow renders all six exact rows with status, task, worker, and model.agent-behavior,3.0.0,Default Taxonomy, serialized artifact runtime contract, or Taxonome saved-prompt “replay” wording. Remaining replay references are immutable recorded-spike evidence or unrelated SSE log replay.ax-taxonomy@r1;1.0.0;taxonomeoutput;pp-atif/pp-taxonomy, post-processor, gateway, and Copilot worker queues.The root monorepo run completed 3,935 passing tests and 59 failures caused by the local Node 25
localStorageimplementation lackingsetItemacross pre-existing Portal suites. Focused touched Portal suites pass; this environment-only failure was not broadened into unrelated changes.Acceptance tests use injected fake executors and make no paid/live model calls. Recording acceptance used the authenticated Copilot SDK path: ten reviewed ATIF v1 inputs and five exact Scope-v2 archive roots completed the full six-element taxonomy with no failed roots.
Documentation and compatibility
Updated:
docs/architecture/db.mddocs/architecture/experiments.mddocs/architecture/post-processing.mddocs/architecture/taxonome.mddocs/architecture/trajectory-taxonomy-format.mdENV_VARIABLES.mdLocal fresh-database startup ordering is API →
register-agentswith Copilot enabled →model-scanner-copilot; the standarddocker:dev:copilotflow already encodes this, while manual selective restarts must preserve it.Migration 037 is non-destructive and Cosmos-compatible. The identity replacement is development-only: no legacy active alias or compatibility migration is introduced. Immutable historical evidence remains unchanged. Optimized YAML is the only runtime optimization input; manifests contain bounded provenance and no complete ATIF, examples, demonstrations, or serialized runtime program.
Checklist
up()/down()and keep it CosmosDB-compatible.NOTICE/NOTICE-REVIEW.txtas needed. (Workspace/site dependency updates only; no new third-party notice content.)