Huang, Zeyu
- Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free
2025/05/10 by Zihan Qiu, Zekun Wang, Qiu, Zihan +23 · 3 voices · 40 citations
Computer Science · #Topic Modeling #Machine Learning in Healthcare #Big Data and Digital Economy
- Transformer-Patcher: One Mistake worth One Neuron
2023/01/24 by Huang, Zeyu, Shen, Yikang, Zhang, Xiaofeng +3 · 15 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- Stacking Your Transformers: A Closer Look at Model Growth for Efficient LLM Pre-Training
2024/05/24 by Wenyu Du, Du, Wenyu, Tongxu Luo +13 · 14 citations
Social Sciences · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Law #Computation and Language (cs.CL) #FOS: Computer and information sciences
- Mixture of Attention Heads: Selecting Attention Heads Per Token
2022/10/11 by Zhang, Xiaofeng, Shen, Yikang, Huang, Zeyu +3 · 5 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Demons in the Detail: On Implementing Load Balancing Loss for Training Specialized Mixture-of-Expert Models
2025/01/21 by Zihan Qiu, Qiu, Zihan, Zeyu Huang +17 · 8 citations
Decision Sciences · Computer Science · #Simulation Techniques and Applications #Scientific Computing and Data Management #AI-based Problem Solving and Planning
- A Closer Look into Mixture-of-Experts in Large Language Models
2024/06/26 by Ka Man Lo, Zeyu Huang, Lo, Ka Man +7 · 6 citations
Social Sciences · #Computation and Language (cs.CL) #Computational and Text Analysis Methods #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Blending Supervised and Reinforcement Fine-Tuning with Prefix Sampling
2025/07/02 by Zeyu Huang, Huang, Zeyu, Tianhao Cheng +11 · 16 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Natural Language Processing Techniques #Topic Modeling
- DiscipLink: Unfolding Interdisciplinary Information Seeking Process via Human-AI Co-Exploration
2024/08/01 by Chengbo Zheng, Yuanhao Zhang, Zheng, Chengbo +9 · 5 citations
Computer Science · #Semantic Web and Ontologies
- Post-hoc Reward Calibration: A Case Study on Length Bias
2024/09/25 by Zeyu Huang, Huang, Zeyu, Zihan Qiu +7 · 5 citations
Decision Sciences · Engineering · #Advanced Statistical Process Monitoring #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Fault Detection and Control Systems #Scientific Measurement and Uncertainty Evaluation
- Unlocking Continual Learning Abilities in Language Models
2024/06/25 by Du, Wenyu, Cheng, Shuang, Luo, Tongxu +5 · 4 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- FRI-Net: Floorplan Reconstruction via Room-wise Implicit Representation
2024/07/15 by Honghao Xu, Juzhan Xu, Xu, Honghao +9 · 2 citations
Computer Science · Engineering · #Advanced Vision and Imaging #Advancements in Photolithography Techniques
- Testing space-time non-commutativity with TianQin
2024/01/23 by Huang, Zeyu, Shi, Changfu, Lyu, Xiangyu +1 · 1 citation
#FOS: Physical sciences #General Relativity and Quantum Cosmology (gr-qc)
- Spatial and Surface Correspondence Field for Interaction Transfer
2024/05/06 by Zeyu Huang, Honghao Xu, Huang, Zeyu +9 · 1 citation
Computer Science · Engineering · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Graphics (cs.GR) #Interactive and Immersive Displays #Machine Learning (cs.LG) #Modular Robots and Swarm Intelligence
- PFME: A Modular Approach for Fine-grained Hallucination Detection and Editing of Large Language Models
2024/06/29 by Deng, Kunquan, Huang, Zeyu, Li, Chen +3 · 1 citation
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- MVISU-Bench: Benchmarking Mobile Agents for Real-World Tasks by Multi-App, Vague, Interactive, Single-App and Unethical Instructions
2025/08/12 by Huang, Zeyu, Wang, Juyuan, Chen, Longfeng +4 · 2 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences