alex000kim/nanoRL

One RL training loop that runs CartPole on a laptop and disaggregated async RLVR on a GPU cluster. About 1,800 lines across 7 files. No Ray, no TRL, no DeepSpeed. It's small enough to read in an afternoon, and it's meant to be forked, not imported.

11 best points · 0 comments · 1 Hacker News post · 13 GitHub stars · View on GitHub

Hacker News discussions

• Show HN: NanoRL – RL training for LLMs in ~1,800 lines (11 points, 0 comments, by alex000kim, 2026-08-13)