← Explore
TOPIC

#quantization

Open source repositories tagged with #quantization, ranked by health score.

timtoole02
timtoole02/Camelid
Rust
89
health

Camelid: a Rust-native local inference backend with evidence-gated model compatibility.

★ 215
intel
intel/auto-round
Python
88
health

A simple and effective post training quantization toolkit for high-accuracy low-bit LLM inference|简洁且高效的后训练量化工具包

★ 1.6k
headpiece747
headpiece747/ninfer-5090-windows
C++
84
health

Native Windows port of NInfer engine for RTX 5090. Features Qwen3.8-27B with QUASAR and NInfer models, MTP/DFlash2 with vision and 262,144 context

★ 55
prabanta-dev
prabanta-dev/janas
C
80
health

Janas-LLM: large mixture-of-experts language models on ordinary computers, in C. Experts streamed from NVMe, with or without a GPU.

★ 32
cookiespiggy
cookiespiggy/agentic-rl
Python
80
health

Agentic RL 中文零基础教程(33 章):从概念到 GRPO 实战,含 TRL 最小可跑示例;26–33 章附一套可运行的三方判别模型实证工程(encoder vs LLM-LoRA vs 规则基线)。第 25 章讲清 Jev / TypeSafe System One 与 RL 的能力边界 | Chinese Agentic RL tutorial (33 chapters) + a reproducible discriminative-model benchmark

★ 119