Zhang, Longteng

1. LoRA-FA: Efficient and Effective Low Rank Representation Fine-tuning
   2023/08/07 by Longteng Zhang, Zhang, Longteng, Lin Zhang +7 · 26 citations
   Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
2. Evaluation and Optimization of Gradient Compression for Distributed Deep Learning
   2023/06/15 by Lin Zhang, Longteng Zhang, Zhang, Lin +7 · 2 citations
   Computer Science · Engineering · #Distributed #FOS: Computer and information sciences #Face and Expression Recognition #Machine Learning (cs.LG) #Parallel #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
3. Dissecting the Runtime Performance of the Training, Fine-tuning, and Inference of Large Language Models
   2023/11/07 by Longteng Zhang, Zhang, Longteng, Xiang Liu +19 · 2 citations
   Computer Science · Engineering · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Natural Language Processing Techniques #Performance (cs.PF) #Topic Modeling