jzhang38/TinyLlama

The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

201 best points · 60 comments · 1 Hacker News post · 9,007 GitHub stars · View on GitHub

Hacker News discussions

• TinyLlama project aims to pretrain a 1.1B Llama model on 3T tokens (201 points, 60 comments, by cmitsakis, 2023-09-04)