← Explore
TOPIC

#turboquant

Open source repositories tagged with #turboquant, ranked by health score.

artalis-io
artalis-io/bitnet.c
C
81
health

Minimal, zero-dependency LLM inference in pure C11. CPU-first with NEON/AVX2 SIMD. Flash MoE (pread + LRU expert cache). TurboQuant 3-bit KV compression (8.9x less memory per session). 20+ GGUF quant formats. Compiles to WASM.

20