Back to papers
August 25, 2026cs.LG

Effective Learning Rate Governs Loss Dynamics in Language Model Pretraining

Zihan Liu, Ruiheng Zheng, Shaobo Zhang, Changxin Tian, Kunlong Chen, Zhiqiang Zhang, Lei Wu
Read on arXivDownload PDF
Categories

cs.LG