Mozilla-Ocho/llamafile

Distribute and run LLMs with a single file.

1,075 best points · 289 comments · 8 Hacker News posts · 26,577 GitHub stars · View on GitHub

Hacker News discussions

• Llamafile lets you distribute and run LLMs with a single file (1,075 points, 288 comments, by tfinch, 2023-11-29)
• Llamafile 0.4 now with Mixtral support (6 points, 1 comments, by louismerlin, 2023-12-14)
• llamafile v0.8 (4 points, 0 comments, by birriel, 2024-04-25)
• Llamafile 0.8.2 Release with Embedding Subcmd in CLI and Performance Boost (3 points, 0 comments, by lijunhao, 2024-05-10)
• Llamafile 0.8.6 CPU Benchmark (3 points, 0 comments, by tosh, 2024-05-26)
• Llamafile v0.8.7 (2 points, 0 comments, by lijunhao, 2024-06-24)
• Released llamafile 0.8.13 with gemma2, new whisper and Stable Diffusion CLI (2 points, 0 comments, by mseri, 2024-08-19)
• Llamafile (1 points, 0 comments, by brundolf, 2025-05-11)