algorithmicsuperintelligence/optillm

Optimizing inference proxy for LLMs

[view on github]last commit: Oct 11, 2026

stars

4,323

7d

+7

30d

+25

90d

+145

## star history

## found in

Awesome Open Source AI/Additional Inference Engines