transfer-engine

Here is 1 public repository matching this topic...

OrbiTE is a transfer engine for LLM inference.

rust cuda gpudirect-rdma rdma nvlink io-uring kv-cache ai-infra llm-inference gpudirect-storage transfer-engine

To associate your repository with the transfer-engine topic, visit your repo's landing page and select "manage topics."