raghavc/LLM-RLHF-Tuning-with-PPO-and-DPO

Comprehensive toolkit for Reinforcement Learning from Human Feedback (RLHF) training, featuring instruction fine-tuning, reward model training, and support for PPO and DPO algorithms with various configurations for the Transformer 5 models including Qwen 3.0

30 best points · 9 comments · 1 Hacker News post · 195 GitHub stars · View on GitHub

Hacker News discussions

• Show HN: Next-Gen AI Training: LLM-RLHF-Tuning with PPO and DPO (30 points, 9 comments, by rags1, 2024-03-18)