jundot/omlx
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
[view on github]last commit: Jun 18, 2026
stars
16,834
7d
+377
30d
-
90d
-
## star history
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar