Skip to content

[Feat][Knowledge] Distill Ascend RC model and fusion performance history - #354

Merged
jiangkuaixue123 merged 8 commits into
InferMatrixLab:mainfrom
jiangkuaixue123:codex/vllm-ascend-0271rc1-skill
Nov 5, 2026
Merged

jiangkuaixue123 merged 8 commits into
InferMatrixLab:mainfrom
jiangkuaixue123:codex/vllm-ascend-0271rc1-skill

Conversation

@jiangkuaixue123

@jiangkuaixue123 jiangkuaixue123 commented Nov 5, 2026 •

Copy link
Copy Markdown
Collaborator

Governing Issue and delivery slice

Refs #350

The requester authorized v0.27.1rc1 Repo-to-Skill distillation, PR submission and the expanded performance scope below. This slice complements the separately assigned historical ACLGraph and checkpoint-adaptation work.

Knowledge authorship declaration

{
  "schema_version": 1,
  "head_sha": "aeb267fb5cefa1139efb2ebac2dcc2220ded5bf5",
  "human_only": false,
  "material_ai_authors": [
    {
      "tool": "Codex (/root)",
      "model_id": "gpt-6-astra",
      "effort": "xhigh",
      "role": "author"
    },
    {
      "tool": "Codex (/root/review)",
      "model_id": "gpt-6-astra",
      "effort": "xhigh",
      "role": "author"
    },
    {
      "tool": "Codex (/root/deepseek)",
      "model_id": "gpt-6-astra",
      "effort": "xhigh",
      "role": "author"
    },
    {
      "tool": "Codex (/root/models)",
      "model_id": "gpt-6-astra",
      "effort": "xhigh",
      "role": "author"
    }
  ]
}

Changed artifacts and evidence

The registered vllm-ascend skill now covers performance mechanisms, source evolution, current eligibility, reversals and the closest test oracles.

Requested scope Delivered resource
DeepSeek-V4 support through performance optimization references/deepseek-v4-evolution.md traces original support, HcPre reversal, cache plans, async metadata, IndexCache, DSpark projection/input work and boundary fixes
Fusion-related history and performance knowledge references/fused-operators.md covers graph norm/quant/RoPE, GMM-SiTU/SwiGLU, one-collective SFA DCP, MLA prolog, GDN paths, sampling and removed fusions
DSA-CP, FlashComm1, Fused-MC2, DSpark references/communication-config.md and the DSpark resources trace requested versus derived state, SP ownership, model/device conflicts, environment migration, MegaMoe rollback and capacity
Kimi K3, MiniMax-M3, GLM5 and later variants references/model-performance.md covers KDA precision/overlap/padding, MSA TP/FP8/top-k and GLM5/5.1/5.2/5.3 index reuse, rotation, loader and fusion constraints

All resources live under src/inferrsi/data/skill_library/repositories/vllm-ascend/. Registry, both matrices, generated coverage and package discovery records are updated. The index generator pins a single committed source snapshot across all records.

History boundary

The official tag resolves to 3b31886237ed65c435e0965b10e8002ff5769766.

  • Enumerated all 5,029 reachable commits in a non-shallow repository.
  • Recorded 1,381 message/path/runtime-diff candidates in docs/reviews/vllm-ascend-0271rc1/history-inventory.json, with an immutable archive link and a packaged reproducible read-only scripts/screen_history.py. The full inventory is excluded from the runtime bundle and wheel.
  • Retained 84 distinct commits in the focused semantic review records. Whole-commit and selected-path review levels remain explicit.
  • Resolved 80 pinned current-source blob identities and checked cited ancestor commits and line bounds.

Candidate screening is broader than semantic extraction. Historical benchmarks remain attributed upstream reports. The procedures keep Kimi K3/GLM source coverage separate from the RC's formal MiniMax-M3/DeepSeek-V4 validation table.

Findings that change optimization decisions

  • The fused-MC2 environment reader was removed. Current config rejects fused MC2 for MiniMax-M3; A5's dispatcher has its own supported choices.
  • DSA-CP depends on effective SP and indexer presence. Legacy FlashComm inputs still influence normalization after the deprecation warning.
  • Kimi K3's preprocessing-copy/mask removal was reverted after reported accuracy/acceptance regressions.
  • IndexCache reuse is cross-layer state with per-forward ownership.
  • Fused top-k/top-p has workload-dependent regressions. The tag uses sort-based non-reduce sampling.
  • Some historical matmul/allreduce fusions have deleted callers; sparse-offload operator presence alone supplies no serving integration.

Review corrections

Addresses the latest source/package review.

  • Corrected the two config anchors to definitions at lines 413 and 404. Added an offline source-anchor checker and 20 regression cases covering wrong in-bounds lines, mismatched pins and Git replacement objects.
  • Archived the complete history inventory byte-for-byte outside package data; runtime readers keep the reviewed records and screening script. Raw skill-file bytes decreased from 1,540,449 to 140,325.
  • Restored source-readset backlinks for every instruction route and guarded them in tests.
  • Added installed-wheel byte checks for the compact JSON and screening script, plus explicit checks that the full inventory is absent.

Checks and dependencies

  • The current catalog/library/knowledge-contract, skill and source-anchor batch passed all 65 tests, including 20 anchor regression cases.
  • Ruff passed across src, tests and tools. Skill validator, index drift, coverage drift and Git whitespace checks passed.
  • Clean detached-checkout wheel build/install and out-of-tree installed-package smoke passed with 128 records; Markdown, compact JSON and screening-script resources were checked, and the complete history inventory was confirmed absent.
  • Two bounded local forward cases recovered the MiniMax-M3/950DT fused-MC2 incompatibility and Kimi K3 A3 revert using the skill.
  • Current-head Ready CI passed all six jobs. Python 3.10 and 3.11 each report 3,578 passed, 13 skipped, 284 subtests passed. Both clean-wheel checks, KV qualification and PR-reference checks passed. Logs identify test merge 2feac43 of head aeb267fb5cefa1139efb2ebac2dcc2220ded5bf5 into base 9dded7adac0ac835f6a73493309399e328a43ab2. The knowledge-model-policy declaration also passed.
  • The earlier macOS full run had 3,519 passes, 24 skips and 18 failures. Two catalog-count failures were corrected. Thirteen other failures reproduced on the base snapshot; three require separate environment/flakiness investigation. Current local relevant tests pass.
  • NPU numerics, native service benchmarks and held-out agent efficacy were not executed. Candidate status remains.

Retained source/index receipt

The common generated source pin now identifies the committed canonical review fixes. The following read-only check ran on the current PR head and returned the recorded output:

head: aeb267fb5cefa1139efb2ebac2dcc2220ded5bf5
source_revision: 2c766dbc95605e61b907ce71418ab941287b427a
environment: Darwin arm64, Python 3.12.14, git version 2.53.0, PyYAML 6.0.3
command: python tools/build_skill_index.py --source-revision 2c766dbc95605e61b907ce71418ab941287b427a --check
exit_status: 0
stdout:
Skill index is current: 80 metadata records
stderr:
(empty)

The separate local upstream-source command python tools/check_vllm_ascend_source_anchors.py --repo <local-vllm-ascend-checkout> exited 0 and returned (the local checkout path is redacted):

Verified 2 source anchors at 3b31886237ed65c435e0965b10e8002ff5769766.
current defaults: vllm_ascend/ascend_config.py#L413-L413: enable_fused_mc2: int = 0
Capacity field: vllm_ascend/ascend_config.py#L404-L404: mega_moe_max_tokens: int = 65536

This verifies the two selected source definitions and generated index consistency. It does not establish NPU numerical accuracy, service performance or agent efficacy.

Remaining work and Issue closure

This PR delivers source-grounded performance procedures and the auditable history screen for review. Broader parent-issue acceptance and native/efficacy validation remain open. No issue closure or empirical promotion is requested.

Trace plugin discovery, mixed MiniMax cache storage and DSpark PD configuration through their consumers and test oracles.

Agent-assisted-by: Codex / gpt-6-astra [effort=xhigh] (author)
Signed-off-by: jiangkuaixue123 <jiangxiaozhou111@163.com>
Regenerate the discovery records against the committed skill sources and verify the new resources in an installed wheel.

Agent-assisted-by: Codex / gpt-6-astra [effort=xhigh] (author)
Signed-off-by: jiangkuaixue123 <jiangxiaozhou111@163.com>
@github-actions

github-actions Bot commented Nov 5, 2026 •

Copy link
Copy Markdown

Skill evaluation

PLANNED: not executed; there are no task outcomes yet.
No approval, model efficacy or current-head test result is implied.

  • Next: run the pinned source/index --check below at head aeb267fb5cefa1139efb2ebac2dcc2220ded5bf5.
  • Task selection: no supported automatic comparison; choose a relevant source/content check and disposition uncovered claims.
  • Selected comparisons: 0 · Estimated task calls: 0. Uncovered/unsupported changes: 106; Canonical library paths: 14; Generated projection paths: 81; Other paths: 11. These are paths, not independent claims.
  • Return: command, input/source pin, exit status, outputs/failures and untested claims for independent verified/refuted/unverified disposition.
Author verification steps (nonpaid; not yet run)
  1. Bind the checkout. Run git rev-parse HEAD; it must equal aeb267fb5cefa1139efb2ebac2dcc2220ded5bf5. If it differs, obtain a current plan; do not reuse old results.
  2. Check source/index consistency. At that PR checkout, using the reviewed repository tool and its documented development dependencies, run:
python tools/build_skill_index.py --source-revision 2c766dbc95605e61b907ce71418ab941287b427a --check

The declared source pin matches this head's canonical library bytes. The command has not run: retain its exit code and full drift/success output. It checks the generated projection, not claim truth or skill efficacy.
No supported automatic comparison is selected. Review the canonical changes and explain which claims need evidence, are unaffected, or remain unverified; do not treat generated records as separate behavioral claims.
Uncovered scope by location: Canonical library paths: 14; Generated projection paths: 81; Other paths: 11. Path counts are not claim counts; no metadata-only conclusion is inferred.
3. Return evidence for independent review: head, check/task/source pin, command, environment, exit status, outputs/failures and untested claims. Label scripted controls. Request each claim's disposition: verified, refuted or unverified; this plan proves neither model provenance nor benefit.
Check recipes and evidence limits

Evidence and logs · Retention: 30 days.
Retained artifacts are verifiable only before Unix time 1796443243 while the linked artifact is available. Expired evidence is unverified.

Plan bindings, budget, frozen exam and advisory details

Advisory: obtain missing evidence

Retained evidence availability: planned / unexecuted. No approval or merge authorization is issued.
Applicable only while these revisions and inputs match the current PR.
Paid execution requires trusted label authorization and cumulative PR reservation. Unknown accounting blocks new paid calls; planning is not execution.
Pipeline evidence only; offline fixed outputs do not establish skill efficacy.
Unchanged-correct is valid neutral evidence, not incremental benefit.
Content/source review and authorship admission remain separate.
Trusted regrading checks retained answers, not model/hardware provenance or a hostile executor; this is not an efficacy certification.

  • Retained evidence is planned / unexecuted.
  • No supported comparison cases were selected.
  • Uncovered/unsupported scope needs a case or explicit reviewer disposition.
    Plan SHA-256: efbcee3d91560ed05e82932fc296459595b05e881b08305916eb25da0084d80d
    Base: 9dded7adac0ac835f6a73493309399e328a43ab2 · Head: aeb267fb5cefa1139efb2ebac2dcc2220ded5bf5
    Trusted implementation: 9dded7adac0ac835f6a73493309399e328a43ab2

Model/settings: {"effort":"not_applicable","name":"claude-opus-5-5"}
Budget: {"comparisons":0,"estimated_calls":0,"limits_per_comparison":{"campaign_seconds":600,"max_task_calls":2,"repeats":1,"timeout_seconds":180,"token_stop_new_trials":200000},"provider_config_sha256":"b28d80f8194fbe0f5a9f01515efb24b218979fd45f702776560da276f4b30d04","reservation":null}

Skill Comparison Cases Estimated calls

Automatic execution / cumulative PR budget:

{"reason":"Trusted configuration or pricing missing, invalid or expired","remaining_usd":"unknown","reserved_or_unresolved_usd":"unknown","spent_or_legacy_usd":"unknown","state":"blocked"}

Projection check selection (not an executed result):

{"declared_in":"src/inferrsi/data/repo_packs/inferrsi/knowledge/README.md","source_revision":"2c766dbc95605e61b907ce71418ab941287b427a","status":"ready"}

Provider/settings: {"client":{"api_version":"2023-06-01","endpoint":"https://yibuapi.com/v1/messages","kind":"anthropic-messages-full-context-v1","max_output_tokens":4096,"max_read_bytes":32768,"max_request_bytes":262144,"max_requests":1,"max_tool_calls":12,"provider":"yibuapi"},"limits":{"token_stop_new_trials":200000},"model":{"effort":"not_applicable","name":"claude-opus-5-5"},"pricing":{"currency":"USD","expires_at":1793271228,"group":"default","max_input_tokens":1000000,"model":"claude-opus-5-5","rate_evidence":"https://github.com/InferMatrixLab/InferRSI/issues/215#issuecomment-6467531341","rates":{"cache_read":"0.4","cache_write":"10","input":"8","output":"40"},"request_fee":"0","unit":"per_million_tokens"},"spend_limit":{"amount":"200","currency":"USD"}}

Uncovered / unsupported paths (106)
  • uncovered: "docs/reference-matrix.md"
  • uncovered: "docs/reviews/vllm-ascend-0271rc1/history-inventory.json"
  • uncovered: "docs/searchspace-matrix.md"
  • uncovered: "docs/skill-coverage.md"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/README.md"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-aclgraph-capture-replay.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-device-health.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-distributed-parallel.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-graph-mode.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-model-adaptation.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-operator-profiling.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-operator-tuning.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-optimization-casebook.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-performance-analysis.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-video-diffusion-optimization.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascendc-tiling-design.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/cann-attribution-overlap.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/torch-npu.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/torchnpu-device-memory-lifecycle.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/torchnpu-pinned-host-memory-lifecycle.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/vllm-ascend.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/assess-serving-preemption.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/assess-split-backward-schedule.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-fixed-workload-claim.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-h3-metal-fasth3-semantics.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-h3-runtime-residency.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-llama-runtime-state.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-recurrent-kv-finalization.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-sd-cpp-residency.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-sglang-diffusion-lifetimes.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-vllm-kv-lifetimes.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/bound-windowed-attention-replay.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/budget-speculative-verification.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/calibrate-serving-simulation.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/cgroup-resource-controls.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/checkpoint-recovery-consistency.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/choose-parallel-training-plan.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/cite-check-downstream-pr.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/claim-contract.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/comfy-ui.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/competitor-scan.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/dcp-async-save-performance.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/dense-performance-evidence.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/diagnose-vllm-admission-pressure.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/diffusers-invocation-state.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/draft-acceptance-issue.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/dwarfstar.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/evaluate-elastic-serving-placement.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/generation-cache-lifecycle.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/host-memory-management.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/host-overhead-optimization.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/husky.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/inference-benchmark-design.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/inference-optimization-casebook.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/kernel-writing-guide.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/kv-tier-management.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/lazy-evaluation-stream-lifetimes.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/lily.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/lithos-metal.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/local-dream.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/mistral-rs.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/mlc-llm.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/mlx-swift-lm.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/npu-skill-factory.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/optimization-search-policy.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/os-process-placement.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/performance-ceiling-analysis.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/plan-activation-residency.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/project-maya.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/pytorch.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/repository-evolution-analysis.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/rsi-evidence.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/skill-evolution-playbook.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/splash.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/storage-io-measurement.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/training-input-pipeline.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/training-resource-budget.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/video-diffusion-optimization.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/vllm-metal.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/weight-loading-optimization.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/audit-afd-p2p-exchanges.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/audit-flare-session-lifecycle.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/diagnose-attention-bottlenecks.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/host-overhead-profiling.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/reason-hopper-kernels.json"
  • uncovered: "src/inferrsi/data/skill_library/repositories/vllm-ascend/SKILL.md"
  • uncovered: "src/inferrsi/data/skill_library/repositories/vllm-ascend/metadata.json"
  • uncovered: "src/inferrsi/data/skill_library/repositories/vllm-ascend/references/communication-config.md"
  • uncovered: "src/inferrsi/data/skill_library/repositories/vllm-ascend/references/deepseek-v4-evolution.md"
  • uncovered: "src/inferrsi/data/skill_library/repositories/vllm-ascend/references/dspark-pd.md"
  • uncovered: "src/inferrsi/data/skill_library/repositories/vllm-ascend/references/fused-operators.md"
  • uncovered: "src/inferrsi/data/skill_library/repositories/vllm-ascend/references/history-reviewed.json"
  • uncovered: "src/inferrsi/data/skill_library/repositories/vllm-ascend/references/history-scope.md"
  • uncovered: "src/inferrsi/data/skill_library/repositories/vllm-ascend/references/minimax-cache.md"
  • uncovered: "src/inferrsi/data/skill_library/repositories/vllm-ascend/references/model-performance.md"
  • uncovered: "src/inferrsi/data/skill_library/repositories/vllm-ascend/references/plugin-registration.md"
  • uncovered: "src/inferrsi/data/skill_library/repositories/vllm-ascend/references/sources.md"
  • uncovered: "src/inferrsi/data/skill_library/repositories/vllm-ascend/scripts/screen_history.py"
  • uncovered: "src/inferrsi/data/skill_library/skill-index.json"
  • uncovered: "tests/check_installed.py"
    Additional paths omitted; see retained evidence.

Copy link
Copy Markdown
Collaborator

Review at head 3311a100 (full PR, base main; commits e5ba044e skill sources + 3311a100 index refresh). Not approving yet, mainly because CI is red.

Blocking

  1. full-check (3.10) fails in the Tests (smoke + unit) step at this head (job); full-check (3.11) was still running when I looked. Ruff, installed-package (3.10/3.11), declarations, pr-references and kv-task-qualification are green. I could not read the job log without auth, so I can't tell whether this is caused by the count bumps (tests/check_installed.py 127→128 / 79→80, tests/test_knowledge_contract.py 68→69, tests/test_skill_index.py 79→80) or by something pre-existing on main. The PR description also says the full local pytest was still running. Please share the failing test(s) and fix or explain.
  2. The skill-eval bot asks for python tools/build_skill_index.py --source-revision e5ba044efd64ad874345f58c9cbcc8e3228420d8 --check at this head. Could you post its exit status/output (or point to the CI step that runs it), since the second commit regenerates every package record's source pin?

What I checked (no issues found)

I spot-checked the new vllm-ascend skill against the pinned upstream source. v0.27.1rc1 does resolve to 3b31886237ed65c435e0965b10e8002ff5769766.

  • references/plugin-registration.md: the setup.py entry points (ascend = vllm_ascend:register, plus the four general hooks), _ensure_global_patch being process-local and set after adapt_patch(is_global_patch=True), and the separate DeepseekV4ForCausalLM / DSparkDraftModel registrations all match setup.py, vllm_ascend/__init__.py and vllm_ascend/models/__init__.py.
  • references/minimax-cache.md: the description of _configure_minimax_m3_a5_mixed_kv_cache (platform.py L622) matches the code: both sparse architectures, fp8/fp8_e4m3, the FP8_ATTENTION capability gate, nonzero freq meaning sparse, the complement becoming skip IDs, and stringify + order-preserving dedup before appending. The worked example [0,0,0,1,1] + [4,"sliding_window"] → ["4","sliding_window","0","1","2"] matches tests/ut/test_platform.py L166-186.
  • references/dspark-pd.md: AscendDSparkProposer forces use_cuda_graph = False, sizes hidden-state buffers from the draft model, and uses N or N+1 query tokens depending on sample_from_anchor, as described.
  • SKILL.md: the release scope (MiniMax-M3 on A3 W8A8 / 950DT W8A8C8; DeepSeek-V4-Flash on 950DT W4A8C8; A2 out of scope) and the stack (vLLM v0.27.1, HDK 26.1.1, CANN 9.1.0, PTA 2.10.0 / 2.10.0.post4, Triton Ascend 3.2.2, Python 3.12 images, Mooncake 0.3.11.post1) match docs/source/user_guide/release_notes.md.
  • tests/test_vllm_ascend_rc_skill.py ties the readset links to metadata.json sources[0].paths, which is a good guard. The candidate / not_run status and limitations are stated consistently in metadata, the matrices and the readset.

I did not verify the DeepSeek-V4-Flash tutorial line references (P DP1/TP8 + DSA-CP, D DP8/TP1, the 360-token tier) or the one-card / four-card e2e test bodies, and I did not run anything. Happy to re-review once CI is green.

Copy link
Copy Markdown
Collaborator

Small correction to my comment above: the failing full-check (3.10) job link should be job 127019081427.

Agent-assisted-by: Codex / gpt-6-astra [effort=xhigh] (author)
Signed-off-by: jiangkuaixue123 <jiangxiaozhou111@163.com>

@Dong1017 Dong1017 left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The catalog-count CI failure is cleared at 5360d88e. This is a scoped follow-up to Amy's review, not a whole-PR approval.

  • I read both earlier failing logs: the failures were the Ascend count (75 versus 74) and total SKILL.md count (143 versus 142). The new two-file commit updates those expectations, including the second total assertion in test_skill_index.py; it changes no canonical knowledge or generated projection.
  • Both current-head full checks now pass: Python 3.10 and 3.11 each report 3,548 passed, 13 skipped. All six jobs in this Ready run succeeded.
  • The separate request for a retained receipt of the pinned source/index command remains to be dispositioned. I did not execute that command or extend the upstream-source review, and these software checks establish no model/device efficacy.
Revision binding

Head 5360d88e65a9c75e7745e145662da197077e680d; logs identify merge 6e995c2 of this head into 9dded7adac0ac835f6a73493309399e328a43ab2. Inspected delta: 3311a100..5360d88e.

amy-why-3459
amy-why-3459 previously approved these changes Nov 5, 2026

@amy-why-3459 amy-why-3459 left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

PR review verdict — PASS
Reviewed base 9dded7ad and head 5360d88e. Incremental review 3311a100..5360d88e (one commit, test: account for the new Ascend skill in catalog totals), checked against my previous review.

  • Blocker 1 resolved: the earlier full-check (3.10) failure was exactly tests/test_skill_index.py::test_hardware_filters_include_only_matching_and_shared_skills (75 == 74) and tests/test_skill_library.py::test_library_root_exposes_only_owner_categories_and_required_entrypoints (143 == 142). This commit bumps those totals (ascend 74→75, SKILL.md 142→143), which matches adding one Ascend skill. At this head full-check (3.10), full-check (3.11), installed-package (3.10/3.11), declarations, pr-references and kv-task-qualification are all green.
  • Item 2 resolved: tests/test_skill_index.py regenerates the full index projection with render_index(...) from the recorded source revision and compares it with the committed DESTINATION tree, so the index refresh in 3311a100 is covered by the now-green pytest run.

Still unverified by me (not blocking): the DeepSeek-V4-Flash tutorial line references and the one-card / four-card e2e test bodies noted last time. I did not run anything locally.

Screen all tag-reachable history and retain focused source procedures for DeepSeek V4, Kimi K3, MiniMax M3, GLM5 families and communication/configuration gates.

Agent-assisted-by: Codex / gpt-6-astra [effort=xhigh] (author)
Signed-off-by: jiangkuaixue123 <jiangxiaozhou111@163.com>
Agent-assisted-by: Codex / gpt-6-astra [effort=xhigh] (author)
Signed-off-by: jiangkuaixue123 <jiangxiaozhou111@163.com>
@jiangkuaixue123 jiangkuaixue123 changed the title [Feat][Knowledge] Distill vLLM Ascend v0.27.1rc1 serving diagnostics [Feat][Knowledge] Distill Ascend RC model and fusion performance history Nov 5, 2026

Copy link
Copy Markdown
Collaborator

Re-review at head f426ae4753b4e79b5eda640d9deab2e6113442d8, incremental range 5360d88e..f426ae47 (2 commits: 5004c0ef performance/fusion distillation + f426ae47 index refresh and history-discovery tests). My earlier approval at 5360d88e was dismissed by this push. Not approving this head yet; the content is mostly accurate, but a few things need fixing or confirming.

Needs a fix

  1. Two source anchors in references/communication-config.md point at the wrong line (semantics are right, the link targets are not):
    • L8 (step 2), "current defaults" → ascend_config.py#L384 is a blank line at 3b318862; enable_fused_mc2: int = 0 is at L413.
    • L37 (step 5), "Capacity field" → ascend_config.py#L396 is pa_shape_list; mega_moe_max_tokens: int = 65536 is at L404 (its comment block starts a few lines above).
      The PR text says line bounds were validated, which these pass, but bounds alone don't catch a wrong target. Please correct both, and ideally have the source check assert that the anchored line (or a small window) contains the cited symbol.

Questions / please confirm

  1. references/history-inventory.json is ~1.4 MB (30,368 lines) and ships as package data. It is also listed in the knowledge record's sources[0].paths and covered by content_sha256 in knowledge/ascend/skills/vllm-ascend.json. Is it intended that the wheel carries this, and does KnowledgeReader().read("inferrsi.ascend.skills.vllm_ascend") now load it into content? If so, I'd consider keeping only the reviewed records + the reproducible scripts/screen_history.py in the package and attaching the full inventory elsewhere (or trimming per-commit paths), unless there's a reason agents need the full list at runtime.
  2. tests/test_vllm_ascend_rc_skill.py L31 weakens the route guard from "](sources.md)" in resource to "resource is non-empty". The new references link immutable upstream URLs directly but no longer link back to the readset. Could you keep a readset back-link check (e.g. each route links sources.md or history-scope.md) instead of dropping it?
  3. Minor: tests/check_installed.py only verifies the .md resources in the installed wheel; history-inventory.json, history-reviewed.json and scripts/screen_history.py aren't checked, although the PR body says all new procedure resources were verified. Worth adding them if they're meant to ship.

What I checked (no issues found)

  • CI at f426ae47: full-check (3.10/3.11), installed-package (3.10/3.11), kv-task-qualification, pr-references green. The first declarations run failed on a stale declaration head; both reruns after the body update pass.
  • Spot-checked against upstream vllm-ascend@3b318862: the FlashComm/DSA-CP OR expression (ascend_config.py ~L519–528) including the JSON-false-can't-override-env point; the 0/1/2 fused-MC2 rollback in _validate_user_input_ranges (L455) and is_mega_moe_supported() accessor (L33+); the MiniMax-M3 enable_fused_mc2=1 assertion (L617–623); A3 dispatch (FUSED_MC2 at EP ≤ 32, MegaMoe requires A3/MoE/EP/1 < EP ≤ 64/no LoRA), MC2 vs all-to-all fallback, and A5 having no FUSED_MC2 return (ascend_forward_context.py); the SparseFlashMla "matching CANN 9.2 toolkit" error; and the sort-based non-reduce top-k/top-p path in sample/sampler.py.
  • history-inventory.json totals match the PR body (5029 reachable, 1381 candidates, topic counts 275/148/251/973, pin 3b318862). screen_history.py is read-only, rejects shallow history and uses --no-replace-objects; the new tests cover classification, a clean-checkout fixture and the shallow rejection.
  • The generated knowledge records only change the source pin e5ba044e → 5004c0ef, consistent with the index refresh.

Not verified: NPU numerics/performance (as the PR states), and the remaining commit/line anchors beyond the ones listed above.

Preserve the full discovery ledger outside runtime package data.

Agent-assisted-by: Codex / gpt-6-astra [effort=xhigh] (author)
Signed-off-by: jiangkuaixue123 <jiangxiaozhou111@163.com>
Correct field anchors and validate pinned definitions without replacement objects or lazy fetches. Archive the full history outside runtime resources, restore source backlinks, and verify compact JSON and script resources in installed wheels.

Agent-assisted-by: Codex / gpt-6-astra [effort=xhigh] (author)
Signed-off-by: jiangkuaixue123 <jiangxiaozhou111@163.com>
Regenerate every skill projection from the committed review fixes and remove the archived inventory from runtime source paths.

Agent-assisted-by: Codex / gpt-6-astra [effort=xhigh] (author)
Signed-off-by: jiangkuaixue123 <jiangxiaozhou111@163.com>

@amy-why-3459 amy-why-3459 left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

PR review verdict — PASS
Reviewed base 9dded7ad and head aeb267fb. Incremental review f426ae47..aeb267fb (3 commits: 9fd6fd1e archive inventory, 2c766dbc review fixes, aeb267fb index refresh), checked against my previous review at f426ae47.

All four earlier findings are resolved:

  1. Wrong anchors: references/communication-config.md now links ascend_config.py#L413 (enable_fused_mc2: int = 0) and #L404 (mega_moe_max_tokens: int = 65536) at 3b318862. The new tools/check_vllm_ascend_source_anchors.py checks that a 1–5 line span at the metadata pin contains the exact definition, reading only Git objects with --no-replace-objects --no-lazy-fetch. tests/test_vllm_ascend_source_anchors.py covers blank or unrelated lines, wrong pins, git replace substitution, mutable or abbreviated revisions, broad spans and the CLI path.
  2. 1.4 MB inventory in the wheel: history-inventory.json moved to docs/reviews/vllm-ascend-0271rc1/ and was removed from metadata.json provenance_readsets and from the vllm-ascend.json record's sources[0].paths and source_files. The new test_runtime_reader_keeps_full_history_outside_the_bundle asserts it is not in KnowledgeReader().read(...).content.
  3. Readset back-link: the route test now requires a ](sources.md) or ](history-scope.md) link, and test_every_instruction_route_retains_a_readset_link applies that to every routed reference. The four performance references gained the sources.md back-link.
  4. Installed-package coverage: tests/check_installed.py now byte-compares history-reviewed.json and scripts/screen_history.py and asserts the inventory is absent from the wheel.

The aeb267fb refresh only moves the source pin 5004c0ef → 2c766dbc across the generated records, plus the vllm-ascend.json path and digest changes above. CI at aeb267fb is green: full-check (3.10/3.11), installed-package (3.10/3.11), kv-task-qualification, pr-references, declarations.

Note (non-blocking): the archived inventory link in history-scope.md pins PR-branch commit 9fd6fd1e, which won't be on main after a squash or rebase merge. It follows the same pinning convention as the generated records, so it should keep resolving through the PR ref.

Not verified: NPU numerics or performance (as the PR states), and I did not run the anchor check against a real vllm-ascend clone.

Copy link
Copy Markdown
Collaborator Author

@Dong1017 @amy-why-3459 Thanks for the reviews. All four findings are addressed at current head aeb267fb5cefa1139efb2ebac2dcc2220ded5bf5: corrected source anchors with regression checks, archived the full inventory outside runtime package data, restored readset backlinks, and added JSON/script installed-wheel checks.

The exact-head source/index command, environment, exit status and output are retained in the PR description. Ready CI passed all six jobs; Python 3.10 and 3.11 each report 3,578 passed and 13 skipped.

@amy-why-3459 Thank you for approving this head. @Dong1017 Could you re-review the updated evidence and fixes, and approve if there are no remaining blockers? Please let us know if anything else needs addressing. Native NPU numerics/performance and agent efficacy remain unverified, as documented.

Dong1017 commented Nov 5, 2026

Copy link
Copy Markdown
Collaborator

@jiangkuaixue123 Re-checked the four review fixes and updated evidence at head aeb267fb5cefa1139efb2ebac2dcc2220ded5bf5.

  • The two config links now target the definitions at upstream 3b318862 lines 413 and 404. I read those pinned source lines and the checker/regression tests: the checks require the exact definition within a bounded span and reject wrong pins and replacement-object substitution.
  • The generated runtime record no longer includes the full inventory; metadata retains the compact reviewed history. The runtime and installed-wheel tests cover inventory exclusion and the JSON/script resources.
  • The routed-reference tests again require a sources.md or history-scope.md backlink.
  • My earlier missing-receipt item is resolved: the PR description now retains the exact-head source/index command, source pin 2c766dbc, environment, exit status 0 and output. The two-anchor receipt is also present. I confirmed all six jobs in Ready CI and the current-head knowledge-model-policy status are successful.

I found no remaining blocker in these fixes and the evidence update. This is a scoped review comment, not a formal approval. I read the source, tests and recorded CI results; I did not rerun the commands locally or validate the full upstream history, native NPU numerics/performance, or agent efficacy. The documented candidate status and broader #350 acceptance boundary remain unchanged.

@Dong1017 Dong1017 left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approved at head aeb267fb5cefa1139efb2ebac2dcc2220ded5bf5, following the current-head review and evidence disposition. I rechecked the head, discussion, review threads and CI status before submitting; no material change or new blocker was found.

The four review findings and missing source/index receipt are resolved within the documented source-grounded candidate slice. Native NPU numerics/performance and agent efficacy remain unverified. This approval does not complete the broader #350 acceptance or promote the candidate.

@jiangkuaixue123
jiangkuaixue123 merged commit 6fefa01 into InferMatrixLab:main Nov 5, 2026
13 checks passed
cursor Bot pushed a commit that referenced this pull request Nov 5, 2026
…ith #354

Keep the installed-record formula of 49 topic records plus the skill index,
and record main's added skill so the skill count is 80. Regenerate
docs/skill-coverage.md from the combined registry, matrices and plans.

Agent-assisted-by: Grok 4.7 (conflict resolution)
Signed-off-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: amy-why-3459 <amy-why-3459@users.noreply.github.com>
cursor Bot pushed a commit that referenced this pull request Nov 5, 2026
…licts with #354

Conflicts were limited to generated skill projections and the skill coverage view. Regenerated docs/skill-coverage.md from the merged registry and matrices. Knowledge abstracts are refreshed from this merge commit in the following change, because the generator pins a committed source revision.

Agent-assisted-by: Cursor / grok-4.7 [effort=unknown] (conflict resolution)
Signed-off-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: amy-why-3459 <amy-why-3459@users.noreply.github.com>
cursor Bot pushed a commit that referenced this pull request Nov 5, 2026
… conflicts with #354

Keep both appended matrix sections: main's vLLM Ascend v0.27.1rc1 notes and this branch's Issue #49 conditioning-transport notes. The installed catalog counts 129 knowledge records because each side added one distinct record. Generated skill abstracts follow main in this merge and are refreshed from this commit next. Skill coverage is regenerated from the merged matrices and registry.

Agent-assisted-by: Cursor / grok-4.7 (conflict resolution)
Signed-off-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: amy-why-3459 <amy-why-3459@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants