JoniMartin27/inferbench

Benchmark local LLM inference speed (tokens/sec) on your own hardware — llama.cpp native + cloud APIs, 124-model catalog, optimal-quant picker, and an MCP serve mode.

2 best points · 0 comments · 1 Hacker News post · 2 GitHub stars · View on GitHub

Hacker News discussions

• Show HN: InferBench – Benchmark local LLM engines with one click (2 points, 0 comments, by JoniMartin, 2026-06-05)