Xuyang, Shijie
- Predictable Scale: Part I, Step Law -- Optimal Hyperparameter Scaling Law in Large Language Model Pretraining
2025/03/06 by Li, Houyi, Zheng, Wenzhen, Wang, Qiufeng +10 · 23 citations
#Artificial Intelligence (cs.AI) #F.2.2 #FOS: Computer and information sciences #I.2.7 #Machine Learning (cs.LG)
- Predictable Scale: Part II, Farseer: A Refined Scaling Law in Large Language Models
2025/06/12 by Houyi Li, Li, Houyi, Wenzhen Zheng +19 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #I.2 #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling