Open source repositories tagged with #llm-inference, ranked by health score.
OpenVINO™ is an open source toolkit for optimizing and deploying AI inference
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
