Lightning-AI/LitServe
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.
[view on github]last commit: May 4, 2026
stars
3,883
7d
+1
30d
+7
90d
+90
## star history
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.