vix.ing · top · new · best · stats · spec

Zhengyan Zhang

  1. DeepSeek-R1 incentivizes reasoning in LLMs through reinforcement learning
    DeepSeek-R1 shows an LLM can learn strong step-by-step reasoning from pure reinforcement learning, with no human-labeled reasoning examples.
    2025/01/22 by DeepSeek-AI, Daya Guo, Dejian Yang +404 · 93 voices · 1694 citations
    Computer Science · #Reinforcement Learning in Robotics #Data Stream Mining Techniques #Explainable Artificial Intelligence (XAI)
  2. Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention
    2025/02/16 by Jingyang Yuan, Yuan, Jingyang, Huazuo Gao +28 · 19 voices · 128 citations
    Computer Science · #Advanced Neural Network Applications #Stochastic Gradient Optimization Techniques #cs.AI #cs.CL #cs.LG
  3. DeepSeek-V3 Technical Report
    2024/12/27 by DeepSeek-AI, Aixin Liu, Liu, Aixin +404 · 39 voices · 7 citations
    Computer Science · Engineering · #Distributed and Parallel Computing Systems #Robotics and Automated Systems #cs.AI #cs.CL
  4. Graph Neural Networks: A Review of Methods and Applications
    2018/12/20 by Jie Zhou, Zhou, Jie, Ganqu Cui +15 · 1 voice · 182 citations
    Computer Science · #Advanced Graph Neural Networks #Graph Theory and Algorithms #Topic Modeling #cs.AI #cs.LG #stat.ML
  5. mHC: Manifold-Constrained Hyper-Connections
    2025/12/31 by Zhenda Xie, Yixuan Wei, Huanqi Cao +17 · 18 voices · 6 citations
    #cs.CL #cs.AI #cs.LG
  6. Graph neural networks: A review of methods and applications
    2020/01/01 by Jie Zhou, Ganqu Cui, Shengding Hu +6 · 120 citations
    Computer Science · #Advanced Graph Neural Networks #Graph Theory and Algorithms #Topic Modeling
  7. KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representation
    2019/11/13 by Xiaozhi Wang, Tianyu Gao, Wang, Xiaozhi +11 · 29 citations
    Computer Science · #Advanced Graph Neural Networks #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
  8. ERNIE: Enhanced Language Representation with Informative Entities
    2019/05/17 by Zhengyan Zhang, Xu Han, Zhang, Zhengyan +9 · 1 voice · 25 citations
    Computer Science · #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling #cs.CL
  9. Hidden Killer: Invisible Textual Backdoor Attacks with Syntactic Trigger
    2021/05/26 by Fanchao Qi, Qi, Fanchao, Mukai Li +11 · 26 citations
    Computer Science · #Adversarial Robustness in Machine Learning #Computation and Language (cs.CL) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Network Security and Intrusion Detection #Topic Modeling
  10. InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context Memory
    2024/02/07 by Chaojun Xiao, Pengle Zhang, Xiao, Chaojun +13 · 44 citations
    Computer Science · #Neural Networks and Applications
  11. Turbo Sparse: Achieving LLM SOTA Performance with Minimal Activated Parameters
    2024/06/10 by Yixin Song, Song, Yixin, Haotong Xie +12 · 1 voice · 6 citations
    Computer Science · Engineering · #Blind Source Separation Techniques #Neural Networks and Applications #Advanced Wireless Communication Techniques
  12. Conditional Memory via Scalable Lookup: A New Axis of Sparsity for Large Language Models
    2026/01/12 by Xin Cheng, Rui Tian, Wangding Zeng +18 · 4 voices · 2 citations
    #cs.CL #cs.AI
  13. CPT: Colorful Prompt Tuning for Pre-trained Vision-Language Models
    2021/09/24 by Yuan Yao, Yao, Yuan, Ao Zhang +9 · 7 citations
    Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Topic Modeling
  14. ReLU2 Wins: Discovering Efficient Activation Functions for Sparse LLMs
    2024/02/06 by Zhengyan Zhang, Yixin Song, Zhang, Zhengyan +17 · 2 voices · 7 citations
    Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #cs.AI #cs.LG
  15. Finding Skill Neurons in Pre-trained Transformer-based Language Models
    2022/11/14 by Xiaozhi Wang, Wang, Xiaozhi, Kaiyue Wen +9 · 7 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques
  16. CPM: A Large-scale Generative Chinese Pre-trained Language Model
    2020/12/01 by Zhengyan Zhang, Xu Han, Zhang, Zhengyan +47 · 6 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  17. CUGE: A Chinese Language Understanding and Generation Evaluation Benchmark
    2021/12/27 by Yuan Yao, Qingxiu Dong, Yao, Yuan +67 · 4 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
  18. CPM-2: Large-scale Cost-effective Pre-trained Language Models
    2021/06/20 by Zhengyan Zhang, Zhang, Zhengyan, Yuxian Gu +35 · 3 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
  19. ProSparse: Introducing and Enhancing Intrinsic Activation Sparsity within Large Language Models
    2024/02/21 by Chenyang Song, Song, Chenyang, Xu Han +19 · 4 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #I.2.7 #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
  20. Configurable Foundation Models: Building LLMs from a Modular Perspective
    2024/09/04 by Chaojun Xiao, Zhengyan Zhang, Xiao, Chaojun +43 · 4 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Semantic Web and Ontologies
  21. CA-LoRA: Adapting Existing LoRA for Compressed LLMs to Enable Efficient Multi-Tasking on Personal Devices
    2023/07/15 by Weilin Zhao, Yuxiang Huang, Zhao, Weilin +11 · 1 citation
    Computer Science · Engineering · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Speech Recognition and Synthesis #Topic Modeling