SJTU-IPADS/PowerInfer

High-speed Large Language Model Serving for Local Deployment

[view on github]last commit: May 11, 2026

stars

9,487

7d

+18

30d

+101

90d

+795

## star history

## found in

Awesome Open Source AI/Additional Inference Engines