Zihan Qiu
- Qwen3 Technical Report
2025/05/14 by An Yang, Anfeng Li, Yang, An +123 · 1 voice · 1800 citations
Computer Science · Medicine · #Topic Modeling #Artificial Intelligence in Healthcare and Education #Multimodal Machine Learning Applications
- Qwen2.5 Technical Report
2024/12/19 by Qwen, An Yang, : +88 · 4 voices · 887 citations
Computer Science · Medicine · #Topic Modeling #Artificial Intelligence in Healthcare and Education #Machine Learning and Data Classification
- Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free
2025/05/10 by Zihan Qiu, Zekun Wang, Qiu, Zihan +23 · 3 voices · 40 citations
Computer Science · #Topic Modeling #Machine Learning in Healthcare #Big Data and Digital Economy
- Supported Policy Optimization for Offline Reinforcement Learning
2022/02/13 by Jialong Wu, Haixu Wu, Wu, Jialong +7 · 8 citations
Computer Science · Engineering · #Reinforcement Learning in Robotics #Smart Grid Energy Management #Smart Parking Systems Research
- Stacking Your Transformers: A Closer Look at Model Growth for Efficient LLM Pre-Training
2024/05/24 by Wenyu Du, Tongxu Luo, Du, Wenyu +13 · 14 citations
Social Sciences · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Law #Computation and Language (cs.CL) #FOS: Computer and information sciences
- Demons in the Detail: On Implementing Load Balancing Loss for Training Specialized Mixture-of-Expert Models
2025/01/21 by Zihan Qiu, Qiu, Zihan, Zeyu Huang +17 · 8 citations
Decision Sciences · Computer Science · #Simulation Techniques and Applications #Scientific Computing and Data Management #AI-based Problem Solving and Planning
- A Closer Look into Mixture-of-Experts in Large Language Models
2024/06/26 by Ka Man Lo, Zeyu Huang, Lo, Ka Man +7 · 6 citations
Social Sciences · #Computation and Language (cs.CL) #Computational and Text Analysis Methods #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Blending Supervised and Reinforcement Fine-Tuning with Prefix Sampling
2025/07/02 by Zeyu Huang, Tianhao Cheng, Huang, Zeyu +11 · 16 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Natural Language Processing Techniques #Topic Modeling
- Post-hoc Reward Calibration: A Case Study on Length Bias
2024/09/25 by Zeyu Huang, Zihan Qiu, Huang, Zeyu +7 · 5 citations
Decision Sciences · Engineering · #Advanced Statistical Process Monitoring #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Fault Detection and Control Systems #Scientific Measurement and Uncertainty Evaluation
- HyperMoE: Towards Better Mixture of Experts via Transferring Among Experts
2024/02/20 by Hao Zhao, Zhao, Hao, Zihan Qiu +9 · 4 citations
Computer Science · #Artificial Intelligence (cs.AI) #Expert finding and Q&A systems #FOS: Computer and information sciences #Machine Learning (cs.LG) #Mobile Crowdsensing and Crowdsourcing #Seismology and Earthquake Studies
- Video Repurposing from User Generated Content: A Large-scale Dataset and Benchmark
2024/12/12 by Yongliang Wu, Wenbo Zhu, Wu, Yongliang +18 · 2 citations
Computer Science · #Video Analysis and Summarization #Image Retrieval and Classification Techniques #Generative Adversarial Networks and Image Synthesis