kvcache-ai/ktransformers
A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
[view on github]last commit: Jun 18, 2026
stars
17,312
7d
+46
30d
+132
90d
+555
## star history
A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations