HackerGit Trending Discord Star

gianlucamazza/xllama

Local LLM inference on Xbox Series S in Developer Mode: llama.cpp (GGUF) + ONNX Runtime GenAI, an OpenAI-compatible LAN endpoint (off by default), SD-Turbo image generation and experimental on-device fine-tuning. Not yet tested on Series X. Independent project, not affiliated with Microsoft.

2 best points · 0 comments · 1 Hacker News post · 82 GitHub stars · View on GitHub

Hacker News discussions