kvcache-ai/ktransformers

A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations

[view on github]last commit: Apr 14, 2026

stars

16,981

7d

+51

30d

-

90d

-

## star history

## found in

Awesome Open Source AI/High-performance Serving & API Servers