Lian, Haoran

1. Scaffold-BPE: Enhancing Byte Pair Encoding for Large Language Models with Simple and Effective Scaffold Token Removal
   2024/04/27 by Haoran Lian, Yizhe Xiong, Lian, Haoran +16 · 5 citations
   Computer Science · #Advanced Neural Network Applications #Algorithms and Data Compression #Advanced Data Storage Technologies
2. Temporal Scaling Law for Large Language Models
   2024/04/27 by Xiong, Yizhe, Chen, Xiansheng, Ye, Xin +8 · 1 citation
   #Computation and Language (cs.CL) #FOS: Computer and information sciences
3. MaskMoE: Boosting Token-Level Learning via Routing Mask in Mixture-of-Experts
   2024/07/13 by Zhenpeng Su, Zijia Lin, Su, Zhenpeng +19 · 1 citation
   Computer Science · #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning and Algorithms #Machine Learning and Data Classification
4. UniAttn: Reducing Inference Costs via Softmax Unification for Post-Training LLMs
   2025/02/01 by Yizhe Xiong, Huang Wei, Xiong, Yizhe +15 · 2 citations
   Decision Sciences · Engineering · #Scientific Computing and Data Management #Reservoir Engineering and Simulation Methods #Simulation Techniques and Applications
5. LBPE: Long-token-first Tokenization to Improve Large Language Models
   2024/11/08 by Haoran Lian, Yizhe Xiong, Lian, Haoran +13 · 1 citation
   Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling