Wu, Taiqiang
- Rethinking Kullback-Leibler Divergence in Knowledge Distillation for Large Language Models
2024/04/03 by Taiqiang Wu, Wu, Taiqiang, Chaofan Tao +8 · 9 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Semantic Web and Ontologies #Topic Modeling
- Autoregressive Models in Vision: A Survey
2024/11/08 by Jing Xiong, Xiong, Jing, Gongye Liu +37 · 12 citations
Computer Science · Engineering · #Advanced Vision and Imaging #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Image Processing Techniques and Applications #Infrared Target Detection Methodologies
- Mixture-of-Subspaces in Low-Rank Adaptation
2024/06/16 by Taiqiang Wu, Wu, Taiqiang, Jiahao Wang +5 · 5 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural Networks and Applications
- A Survey on the Honesty of Large Language Models
2024/09/27 by Siheng Li, Li, Siheng, Cheng Yang +25 · 5 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning and Data Classification
- Unchosen Experts Can Contribute Too: Unleashing MoE Models' Power by Self-Contrast
2024/05/23 by Chufan Shi, Shi, Chufan, Cheng Yang +15 · 4 citations
Business, Management and Accounting · Computer Science · #Big Data and Business Intelligence #Business Process Modeling and Analysis #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Semantic Web and Ontologies
- PhyX: Does Your Model Have the "Wits" for Physical Reasoning?
2025/05/21 by Shen, Hui, Wu, Taiqiang, Han, Qi +16 · 6 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences
- TencentPretrain: A Scalable and Flexible Toolkit for Pre-training Models of Different Modalities
2022/12/13 by Zhao, Zhe, Li, Yudong, Hou, Cheng +23 · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- RIFormer: Keep Your Vision Backbone Effective While Removing Token Mixer
2023/04/12 by Jiahao Wang, Wang, Jiahao, Songyang Zhang +15 · 1 citation
Computer Science · Neuroscience · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Brain Tumor Detection and Classification #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Visual Attention and Saliency Detection
- Shadow-FT: Tuning Instruct Model via Training on Paired Base Model
2025/05/19 by Wu, Taiqiang, Yang, Runming, Li, Jiayi +4 · 4 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- LoCa: Logit Calibration for Knowledge Distillation
2024/09/07 by Yang, Runming, Wu, Taiqiang, Yang, Yujiu · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- LLM-NEO: Parameter Efficient Knowledge Distillation for Large Language Models
2024/11/11 by Yang, Runming, Taiqiang Wu, Jiahao Wang +9 · 1 citation
Computer Science · #Topic Modeling #Natural Language Processing Techniques