turboderp/exllamav2
A fast inference library for running LLMs locally on modern consumer-class GPUs
[view on github]last commit: Mar 4, 2026
stars
4,556
7d
+6
30d
+30
90d
+96
## star history
A fast inference library for running LLMs locally on modern consumer-class GPUs