llm-d/llm-d

Achieve state of the art inference performance with modern accelerators on Kubernetes

[view on github]last commit: May 23, 2026
stars
3,245
7d
+31
30d
+166
90d
+732
## star history
## found in