waybarrios/vllm-mlx

High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.

33 best points · 4 comments · 2 Hacker News posts · 1,650 GitHub stars · View on GitHub

Hacker News discussions

• vLLM-MLX – Run LLMs on Mac at 464 tok/s (33 points, 3 comments, by waybarrios, 2026-01-16)
• Trying VLLM Ideas on Apple Silicon with MLX (WIP) (2 points, 1 comments, by waybarrios, 2025-12-07)