Zhu, Defa

1. Over-Tokenized Transformer: Vocabulary is Generally Worth Scaling
   2025/01/28 by Hongzhi Huang, Defa Zhu, Huang, Hongzhi +11 · 4 voices · 14 citations
   #cs.CL #cs.LG
2. Seed1.5-Thinking: Advancing Superb Reasoning Models with Reinforcement Learning
   2025/04/10 by Seed, ByteDance, :, Chen, Jiaze +267 · 52 citations
   #Computation and Language (cs.CL) #FOS: Computer and information sciences
3. Hyper-Connections
   2024/09/29 by Zhu, Defa, Huang, Hongzhi, Zihao Huang +10 · 11 citations
   Computer Science · #Advanced Neural Network Applications #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Neural and Evolutionary Computing (cs.NE)
4. Ultra-Sparse Memory Network
   2024/11/19 by Zihao Huang, Qiyang Min, Huang, Zihao +11 · 2 voices · 6 citations
   Computer Science · Engineering · #Advanced Memory and Neural Computing #Machine Learning and ELM #Neural Networks and Reservoir Computing #cs.LG
5. Expert Race: A Flexible Routing Strategy for Scaling Diffusion Transformer with Mixture of Experts
   2025/03/20 by Yike Yuan, Yuan, Yike, Ziyu Wang +9 · 7 citations
   Biochemistry, Genetics and Molecular Biology · Computer Science · #DNA and Biological Computing #Energy Efficient Wireless Sensor Networks
6. Virtual Width Networks
   2025/11/14 by Baisheng Li, Seed, Li, Baisheng +250 · 2 voices
   Computer Science · #Advanced Neural Network Applications #Generative Adversarial Networks and Image Synthesis #Stochastic Gradient Optimization Techniques #cs.AI #cs.LG
7. UltraMemV2: Memory Networks Scaling to 120B Parameters with Superior Long-Context Learning
   2025/08/26 by Huang, Zihao, Bao, Yu, Min, Qiyang +8 · 3 citations
   #FOS: Computer and information sciences #Machine Learning (cs.LG)