huggingface/text-generation-inference

Large Language Model Text Generation Inference

[view on github]last commit: Mar 21, 2026

stars

10,817

7d

-

30d

-

90d

-

## star history

## found in

Awesome Open Source AI/⚡ 3. Inference Engines & Serving