Machine Learning
Gradient Descent Variants for LLMs: A Practical Comparison of SGD, Adam, AdamW, and Sophia
A practical benchmark comparison of SGD, Adam, AdamW, and Sophia optimizers for LLM training, with guidance on when to use each.
Topic
#llm-training
Everything tagged “llm training” across News, Learn, Research and Interviews.
Reinforcement Learning
RLHF to GRPO and Beyond: How Reinforcement Learning Is Transforming LLM Training Pipelines
A comprehensive guide to RLHF, GRPO, DPO, and the reinforcement learning techniques reshaping how large language models are aligned and trained.