mechramc/Orion

Local AI runtime for training & running small LLMs directly on Apple Neural Engine (ANE). No CoreML. No Metal. Offline, on-device fine-tuning & inference on M-series silicon.

2 best points · 1 comments · 1 Hacker News post · 133 GitHub stars · View on GitHub

Hacker News discussions

• Show HN: Orion – Native Training LLMs on the Apple Neural Engine Without CoreML (2 points, 1 comments, by mechramc, 2026-03-05)