SJTU-IPADS/PowerInfer

High-speed Large Language Model Serving for Local Deployment

[view on github]last commit: May 11, 2026

stars

9,570

7d

+22

30d

+99

90d

+743

## star history

## found in

Awesome Open Source AI/Additional Inference Engines