Lightning-AI/LitServe
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.
[view on github]last commit: Jun 9, 2026
stars
3,895
7d
+6
30d
+13
90d
+77
## star history
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.