Open source repositories tagged with #speculative-decoding, ranked by health score.
Fast LLM speculative inference server for consumer hardware.
Pure Rust Inference Engine
