EricLBuehler/mistral.rs

Fast, flexible LLM inference

5 best points · 4 comments · 5 Hacker News posts · 7,817 GitHub stars · View on GitHub

Hacker News discussions

• Mistral.rs: Fast LLM Engine (5 points, 0 comments, by atrudeau, 2024-04-25)
• Fast LLM Inference in Rust (5 points, 0 comments, by goranmoomin, 2024-10-19)
• Thoughts on Mistral.rs (2 points, 2 comments, by ericlbuehler, 2025-04-30)
• Mistral.rs – Fast, zero-config multimodal LLM inference for a variety of models (2 points, 2 comments, by Curiositry, 2026-02-10)
• Mistral.rs: Faster than llama.cpp on CUDA (1 points, 0 comments, by georgehill, 2024-07-24)