abacaj/mpt-30B-inference

Run inference on MPT-30B using CPU

5 best points · 1 comments · 2 Hacker News posts · 571 GitHub stars · View on GitHub

Hacker News discussions

• New open-source model with 8k context runs on CPU, outperforms GPT-3 (5 points, 1 comments, by sheepscreek, 2023-06-30)
• MPT 30B inference code using CPU (3 points, 0 comments, by djha-skin, 2023-06-29)