alibaba/rtp-llm

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

[view on github]last commit: May 24, 2026
stars
1,128
7d
+8
30d
+23
90d
+83
## star history
## found in