Skip to content

chore(pipeline): drop local llama.cpp serving, API-only LLM docs - #231

Merged
dlgrv merged 1 commit into
mainfrom
chore/drop-local-llama
Oct 24, 2026
Merged

dlgrv merged 1 commit into
mainfrom
chore/drop-local-llama

Conversation

@dlgrv

@dlgrv dlgrv commented Oct 24, 2026

Copy link
Copy Markdown
Owner

Why

Local llama.cpp / Hy-MT2 serving is retired — translation runs only on third-party OpenAI-compatible APIs (HTLB_LLM_*). The repo still carried the local-server instructions and launcher, which misleads agents and humans into setting up a local server that is never used.

Changes

  • Delete translate/steps/translate/start-llama-server.sh — the only consumer of the local server.
  • Makefile / AGENTS.md: repoint the make lint shellcheck scope to translate/llm/translate-wave.sh (the deleted script was the only match of the old translate/steps/translate/*.sh glob, which would have hung lint on an empty match).
  • translate/llm/README.md: rewritten — llama.cpp build/server sections removed, new provider-config (.env) section, kept unit/repair-wave instructions verbatim where still true.
  • .env.example: cloud API placeholders instead of 127.0.0.1:8080 / Hy-MT2 defaults; HTLB_LLAMA_CTX dropped.
  • Docs: translate/README.md, docs/pipeline/translation-playbook.md (ops table now says translation — third-party APIs only, local-Q8 bullets removed, subagent waves cloud-only), docs/pipeline/upstream-sync.md wording.
  • Repair docstrings (repair_wave.py, mechanical.py, repair_unit.py): «Hy-MT2 oscillates» → generic LLM wording; the sequential-repair invariant is kept but re-justified (deterministic verify rounds, provider rate limits) instead of llama-server slots.

Leftover «Llama» mentions in book/ / docs/核实记录/ are book content (cited studies) and untouched.

Verification

  • make lint — pass (ruff, djlint, yamllint, shellcheck on new scope)
  • make check-content — all gates pass
  • Python tests: 424 passed, 6 skipped, 2 xfailed; node tests: 0 fail

Local llama.cpp / Hy-MT2 serving is retired: translation runs only on
third-party OpenAI-compatible APIs (HTLB_LLM_*).

- delete translate/steps/translate/start-llama-server.sh (only consumer
  of the local server)
- repoint make lint shellcheck scope to translate/llm/translate-wave.sh
  (the deleted script was the only match of the old glob)
- rewrite translate/llm/README.md and .env.example for provider config
- translate/README.md, repair docstrings, translation-playbook.md,
  upstream-sync.md: replace Hy-MT2/llama-server instructions with
  API-only guidance; keep mechanical-first number repair and the
  sequential repair invariant (now justified by determinism and rate
  limits, not server slots)
@dlgrv
dlgrv merged commit 7b317b7 into main Oct 24, 2026
11 checks passed
@dlgrv
dlgrv deleted the chore/drop-local-llama branch October 24, 2026 18:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant