← Back to Discover
mostlygeek

mostlygeek/llama-swap

GoMITactive
88Health

Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc

Stars4.2k
Forks328
Open Issues71
Contributors328
Last Push0d ago

Health Breakdown

Activity
25
Community
25
Maintenance
13
Popularity
25
#golang#llama#llamacpp#localllama#localllm#openai#openai-api#vllm
View on GitHub ↗Issues (71) ↗Pull Requests ↗Wiki ↗

Community

mostlygeek88

Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc

active
4.2k328 contributors0d ago

More Go repos

axone-protocol
axone-protocol/axoned
⛓️ Axone blockchain 💫
17493
bluenviron
bluenviron/gomavlib
Mavlink library (2.0 and 1.0) for the Go programming language
18991
android-sms-gateway
android-sms-gateway/server
The SMS Gateway for Android™ Server enables the dispatch of SMS messages through Android devices without requiring direct Internet access to them.
12091