assaydepot/red-candle

Ruby gem for running state-of-the-art language models locally. Access LLMs, embeddings, rerankers, and NER models directly from Ruby using Rust-powered Candle with Metal/CUDA acceleration.

5 best points · 1 comments · 1 Hacker News post · 204 GitHub stars · View on GitHub

Hacker News discussions

• Show HN: Red Candle – Run LLMs Natively in Ruby with Rust (5 points, 1 comments, by cpetersen, 2025-07-28)