Zecheng Wang
- Checkpoint Merging via Bayesian Optimization in LLM Pretraining
2024/03/28 by Deyuan Liu, Liu, Deyuan, Zecheng Wang +15 · 3 citations
Engineering · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Manufacturing Process and Optimization #Scheduling and Optimization Algorithms
- Pruning via Merging: Compressing LLMs via Manifold Alignment Based Layer Merging
2024/06/24 by Deyuan Liu, Zhanyue Qin, Liu, Deyuan +27 · 3 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Digital Rights Management and Security #FOS: Computer and information sciences