llm-d/llm-d

Achieve state of the art inference performance with modern accelerators on Kubernetes

[view on github]last commit: Jun 19, 2026
stars
3,405
7d
+58
30d
+188
90d
+758
## star history
## found in