Zeyu Huang
- Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free
2025/05/10 by Zihan Qiu, Zekun Wang, Qiu, Zihan +23 · 3 voices · 41 citations
Computer Science · #Topic Modeling #Machine Learning in Healthcare #Big Data and Digital Economy
- Graph2Plan
2020/04/27 by Ruizhen Hu, Zeyu Huang, Yuhan Tang +4 · 1 voice · 2 citations
Computer Science · #Computer Graphics and Visualization Techniques #Advanced Vision and Imaging #Computational Geometry and Mesh Generation
- Stacking Your Transformers: A Closer Look at Model Growth for Efficient LLM Pre-Training
2024/05/24 by Wenyu Du, Tongxu Luo, Du, Wenyu +13 · 16 citations
Social Sciences · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Law #Computation and Language (cs.CL) #FOS: Computer and information sciences
- A Closer Look into Mixture-of-Experts in Large Language Models
2024/06/26 by Ka Man Lo, Zeyu Huang, Lo, Ka Man +7 · 7 citations
Social Sciences · #Computation and Language (cs.CL) #Computational and Text Analysis Methods #FOS: Computer and information sciences #Machine Learning (cs.LG)
- DiscipLink: Unfolding Interdisciplinary Information Seeking Process via Human-AI Co-Exploration
2024/08/01 by Chengbo Zheng, Yuanhao Zhang, Zheng, Chengbo +9 · 7 citations
Computer Science · #Semantic Web and Ontologies
- Post-hoc Reward Calibration: A Case Study on Length Bias
2024/09/25 by Zeyu Huang, Huang, Zeyu, Zihan Qiu +7 · 8 citations
Decision Sciences · Engineering · #Advanced Statistical Process Monitoring #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Fault Detection and Control Systems #Scientific Measurement and Uncertainty Evaluation
- Demons in the Detail: On Implementing Load Balancing Loss for Training Specialized Mixture-of-Expert Models
2025/01/21 by Zihan Qiu, Zeyu Huang, Qiu, Zihan +17 · 8 citations
Decision Sciences · Computer Science · #Simulation Techniques and Applications #Scientific Computing and Data Management #AI-based Problem Solving and Planning
- Unlocking Continual Learning Abilities in Language Models
2024/06/25 by Wenyu Du, Shuang Cheng, Du, Wenyu +13 · 6 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Intelligent Tutoring Systems and Adaptive Learning #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification
- Blending Supervised and Reinforcement Fine-Tuning with Prefix Sampling
2025/07/02 by Zeyu Huang, Huang, Zeyu, Tianhao Cheng +11 · 17 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Natural Language Processing Techniques #Topic Modeling
- FRI-Net: Floorplan Reconstruction via Room-wise Implicit Representation
2024/07/15 by Honghao Xu, Juzhan Xu, Xu, Honghao +9 · 2 citations
Computer Science · Engineering · #Advanced Vision and Imaging #Advancements in Photolithography Techniques
- Spatial and Surface Correspondence Field for Interaction Transfer
2024/05/06 by Zeyu Huang, Honghao Xu, Huang, Zeyu +9 · 1 citation
Computer Science · Engineering · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Graphics (cs.GR) #Interactive and Immersive Displays #Machine Learning (cs.LG) #Modular Robots and Swarm Intelligence
- Empirical Study on Updating Key-Value Memories in Transformer Feed-forward Layers
2024/02/19 by Zihan Qiu, Qiu, Zihan, Zeyu Huang +5 · 1 citation
Materials Science · Engineering · Computer Science · #Magnetic Properties and Applications #Integrated Circuits and Semiconductor Failure Analysis #VLSI and Analog Circuit Testing
- PFME: A Modular Approach for Fine-grained Hallucination Detection and Editing of Large Language Models
2024/06/29 by Kunquan Deng, Zeyu Huang, Deng, Kunquan +9 · 1 citation
Biochemistry, Genetics and Molecular Biology · Computer Science · #Artificial Intelligence (cs.AI) #Big Data and Digital Economy #Biomedical Text Mining and Ontologies #Computation and Language (cs.CL) #FOS: Computer and information sciences #Topic Modeling