InternLM/lmdeploy

PythonApache-2.0activepopular

Health

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Stars7.9k

Forks697

Open Issues584

Contributors697

Last Push3d ago

Health Breakdown

Activity

Community

Maintenance

Popularity

#codellama#cuda-kernels#deepspeed#fastertransformer#internlm#llama#llama2#llama3#llm#llm-inference#turbomind

PythonApache 2.0

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

activepopular

★ 7.9k697 contributors3d ago