google-ai-edge/LiteRT-LM
LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
5 best points · 0 comments · 3 Hacker News posts · 6,840 GitHub stars · View on GitHub
Hacker News discussions
- A C++ library to efficiently run Gemma-3N across various platform (5 points, 0 comments, by BUFU, 2025-06-11)
- A C++ library to efficiently run language models across edge platforms (2 points, 0 comments, by srameshc, 2025-09-25)
- Add NPU support for AICore for Gemma4 model (2 points, 0 comments, by limoce, 2026-03-09)