dvmazur/mixtral-offloading

Run Mixtral-8x7B models in Colab or consumer desktops

4 best points · 0 comments · 2 Hacker News posts · 2,334 GitHub stars · View on GitHub

Hacker News discussions

• Run Mixtral-8x7B models in Colab or consumer desktops (4 points, 0 comments, by tslmy, 2024-01-01)
• Mixtral in Colab (3 points, 0 comments, by reqo, 2024-01-07)