InternLM/lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

[view on github]last commit: Oct 19, 2026

stars

8,108

7d

+4

30d

+26

90d

+175

## star history

## found in

Awesome Open Source AI/High-performance Serving & API Servers