kvcache-ai/ktransformers
A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
[view on github]last commit: Oct 20, 2026
stars
19,619
7d
+17
30d
+96
90d
+2,208
## star history
A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations