google-ai-edge/LiteRT-LM

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

[view on github]last commit: Oct 19, 2026

stars

6,697

7d

+38

30d

+216

90d

+836

## star history

## found in

Awesome Open Source AI/Local / On-device Inference Awesome local LLM/Inference engines