Wenyu Du
- Stacking Your Transformers: A Closer Look at Model Growth for Efficient LLM Pre-Training
2024/05/24 by Wenyu Du, Tongxu Luo, Du, Wenyu +13 · 14 citations
Social Sciences · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Law #Computation and Language (cs.CL) #FOS: Computer and information sciences
- Graphix-T5: Mixing Pre-Trained Transformers with Graph-Aware Layers for Text-to-SQL Parsing
2023/01/18 by Jinyang Li, Binyuan Hui, Li, Jinyang +17 · 9 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Multimodal Machine Learning Applications
- f-Divergence Minimization for Sequence-Level Knowledge Distillation
2023/07/27 by Yuqiao Wen, Wen, Yuqiao, Zichao Li +5 · 8 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- Learning from Peers in Reasoning Models
2025/05/12 by Tongxu Luo, Luo, Tongxu, Wenyu Du +11 · 7 citations
Computer Science · #Advanced Graph Neural Networks #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- m2mKD: Module-to-Module Knowledge Distillation for Modular Transformers
2024/02/26 by Ka Man Lo, Lo, Ka Man, Yiming Liang +13 · 1 citation
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural Networks and Applications
- Thinker: Learning to Think Fast and Slow
2025/05/27 by Wenyu Du, Chung, Stephen, Jie Fu +2 · 2 citations
Computer Science · #Topic Modeling #Multimodal Machine Learning Applications #Text Readability and Simplification