Sign in with GitHub

← Back to Discover

lightseekorg/smg

RustApache-2.0active

Health

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across SGLang, vLLM, TRT-LLM, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

Stars283

Forks82

Open Issues139

Contributors82

Last Push0d ago

Health Breakdown

Activity

25

Community

25

Maintenance

4

Popularity

25

#anthropic#anthropic-api#chat#claude#gemini#inference-gateway#lightseek#llm#mcp#openai#responses-api#routing#sglang#tensorrtllm#trtllm#vllm

View on GitHub ↗Issues (139) ↗Pull Requests ↗

Community

lightseekorg/smg

RustApache 2.0

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across SGLang, vLLM, TRT-LLM, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

active

★ 28382 contributors0d ago

More Rust repos

web3infra-foundation/libra

Libra is evolving into an AI agent–native version control tools

v2ray subscription links

genomoncology/biomcp

BioMCP: Biomedical Model Context Protocol