magnitudedev/magnitude
Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. 2x faster than Ollama. Works on Apple Silicon, NVIDIA, AMD, or just a CPU.
[view on github]last commit: Oct 19, 2026
stars
7,217
7d
+510
30d
-
90d
-
## star history