InternLM/lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

[view on github]last commit: May 23, 2026

stars

7,870

7d

+10

30d

+53

90d

+278

## star history

## found in

Awesome Open Source AI/High-performance Serving & API Servers