InternLM/lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

[view on github]last commit: Jun 18, 2026

stars

7,907

7d

+11

30d

+42

90d

+222

## star history

## found in

Awesome Open Source AI/High-performance Serving & API Servers