kvcache-ai/ktransformers
A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
[view on github]last commit: May 21, 2026
stars
17,191
7d
+15
30d
+123
90d
+705
## star history
A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations