seuros/mdma

Model Dispatch and Memory Allocator: an LLM inference engine for the hardware you own. Custom CPU, ROCm, Vulkan, CUDA, Metal and Level Zero kernels, exact memory admission, mTLS gRPC and private federation.

2 best points · 5 comments · 1 Hacker News post · 19 GitHub stars · View on GitHub

Hacker News discussions

• MDMA: An open source federated LLM inference engine (2 points, 5 comments, by urzil, 2026-10-13)