SJTU-IPADS/PowerInfer

High-speed Large Language Model Serving for Local Deployment

[view on github]last commit: May 11, 2026

stars

9,840

7d

+15

30d

+38

90d

+234

## star history

## found in

Awesome Open Source AI/Additional Inference Engines