ik-llama-cpp

Here are 4 public repositories matching this topic...

Practical local LLM recipes and benchmarks for RTX 5060 Ti setups

benchmark cuda nvidia blackwell llama-cpp vllm qwen ik-llama-cpp

A build log for one workstation: a 284B mixture-of-experts model across two GPUs and 256 GB of RAM, measured.

Turboquant Q4/Q3 with IQK FA

quantization kv-cache llm llama-cpp ik-llama-cpp turboquant

无独显笔记本跑 30B 代码模型：ik_llama.cpp + MoE 量化，纯 CPU 13.67 tok/s，OpenAI 兼容、断网可用、零 API 费用 | CPU-only local LLM on Windows, no GPU needed

windows offline moe no-gpu openai-api cpu-inference llama-cpp local-llm qwen3-coder ik-llama-cpp

To associate your repository with the ik-llama-cpp topic, visit your repo's landing page and select "manage topics."