john-rocky/apple-silicon-llm-bench

Reproducible on-device LLM benchmarks for Apple Silicon (iPhone 17 Pro, M4 Max): Apple Core AI, MLX, llama.cpp, LiteRT-LM and Core ML on the same model and harness, every number with its quantization and capture session; hybrid Mamba-2 models (Nemotron-3 Nano, Granite-4.0-H, Falcon-H1) included.

1 best points · 0 comments · 1 Hacker News post · 73 GitHub stars · View on GitHub

Hacker News discussions

• Show HN: iPhone ANE holds LLM tok/s while MLX and LiteRT thermal-throttle (1 points, 0 comments, by mlboy, 2026-06-04)