ModelTC/LightLLM

PythonApache-2.0active

Health

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

Stars4.1k

Forks329

Open Issues132

Contributors329

Last Push0d ago

Health Breakdown

Activity

Community

Maintenance

Popularity

#deep-learning#gpt#llama#llm#model-serving#nlp#openai-triton

View on GitHub ↗Issues (132) ↗Pull Requests ↗Wiki ↗

Community

ModelTC/LightLLM

PythonApache 2.0

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

active

★ 4.1k329 contributors0d ago

More Python repos

sciencepal/sciencepal

Woooh, it's just me, myself and I

★ 15499

WCGKING/BrandrdXMusic

ᴅɪꜱᴄᴏᴠᴇʀ ᴛʜᴇ ᴇɴᴄʜᴀɴᴛɪɴɢ ᴡᴏʀʟᴅ ᴏꜰ ᴍᴜꜱɪᴄ ᴡɪᴛʜ ⛦🦋ʙʀᴀɴᴅʀᴅ ❥! ᴛʜɪꜱ ᴘʏᴛʜᴏɴ-ʙᴀꜱᴇᴅ ᴛᴇʟᴇɢʀᴀᴍ ᴍᴜꜱɪᴄ ʙᴏᴛ, ᴘᴏᴡᴇʀᴇᴅ ʙʏ ᴘʏʀᴏɢʀᴀᴍ ᴠ2, ʙʀɪɴɢꜱ ʜᴀʀᴍᴏɴʏ ᴛᴏ ʏᴏᴜʀ ᴄʜᴀᴛꜱ. ᴇɴᴊᴏʏ ꜱᴇᴀᴍʟᴇꜱꜱ ᴍᴜꜱɪᴄ ꜱʜᴀʀɪɴɢ ᴀɴᴅ ꜱᴛʀᴇᴀᴍɪɴɢ ɪɴ ꜱᴛʏʟᴇ.

★ 10395

haoyiyin/basjoo

Open-source AI customer support platform — RAG knowledge base, multi-provider LLM agents, embeddable chat widget. FastAPI + Next.js + R2R + pgvector.

★ 9994