setzer22/llama-rs

[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models

202 best points · 24 comments · 2 Hacker News posts · 6,145 GitHub stars · View on GitHub

Hacker News discussions

• Llama.rs – Rust port of llama.cpp for fast LLaMA inference on CPU (202 points, 24 comments, by rrampage, 2023-03-15)
• LLaMA-rs: a Rust port of llama.cpp for fast LLaMA inference on CPU (8 points, 0 comments, by darthdeus, 2023-03-14)