algorithmicsuperintelligence/optillm

Optimizing inference proxy for LLMs

[view on github]last commit: May 7, 2026

stars

4,149

7d

+7

30d

+177

90d

-

## star history

## found in

Awesome Open Source AI/Additional Inference Engines