Li, Dengchun
- MixLoRA: Enhancing Large Language Models Fine-Tuning with LoRA-based Mixture of Experts
2024/04/22 by Dengchun Li, Li, Dengchun, Yingzi Ma +16 · 21 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Topic Modeling
- mLoRA: Fine-Tuning LoRA Adapters via Highly-Efficient Pipeline Parallelism in Multiple GPUs
2023/12/05 by Zhengmao Ye, Dengchun Li, Ye, Zhengmao +16 · 3 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling