algorithmicsuperintelligence/optillm

Optimizing inference proxy for LLMs

[view on github]last commit: May 7, 2026

stars

4,025

7d

+63

30d

-

90d

-

## star history

## found in

Awesome Open Source AI/Additional Inference Engines