A science inference cluster — every model, from protein folding to LLMs, behind one OpenAI/Anthropic-compatible endpoint and a single key. Built to run beside HPC so agentic AI researchers can drive simulations and model inference together. Self-deploying on RKE2 with KServe/Knative + HAMi GPU.
kubernetes nim torch scientific-computing tyk traefik supercomputing inference-engine istio warewulf research-computing knative metallb rke2 kserve hami llms vllm agentic-ai autonomous-science
-
Updated
Oct 30, 2026 - Python