Open source repositories tagged with #infrence, ranked by health score.
llm training and inference in C++ & python with web UI
