Open source repositories tagged with #inference-engine, ranked by health score.
NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.
Large-scale LLM inference engine
Pure C inference engine for Qwen3-TTS text-to-speech. No Python, no PyTorch — just C and BLAS. Supports 0.6B and 1.7B models, 9 voices, 10 languages.
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
