Shijie Cao

1. Pre-gated MoE: An Algorithm-System Co-Design for Fast and Scalable Mixture-of-Expert Inference
   2023/08/23 by Ranggi Hwang, Jianyu Wei, Hwang, Ranggi +11 · 20 citations
   Computer Science · #Topic Modeling #Speech Recognition and Synthesis #Natural Language Processing Techniques
2. SeerAttention: Learning Intrinsic Sparse Attention in Your LLMs
   2024/10/17 by Yizhao Gao, Zhichen Zeng, Gao, Yizhao +16 · 32 citations
   Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning and Data Classification #Topic Modeling
3. BitDistiller: Unleashing the Potential of Sub-4-Bit LLMs via Self-Distillation
   2024/02/16 by Dayou Du, Du, Dayou, Yijia Zhang +11 · 15 citations
   Engineering · #Advancements in Semiconductor Devices and Circuit Design #Semiconductor materials and devices #Advanced Memory and Neural Computing
4. LUT Tensor Core: A Software-Hardware Co-Design for LUT-Based Low-Bit LLM Inference
   2024/08/12 by Zhiwen Mo, Mo, Zhiwen, Lei Wang +19 · 10 citations
   Computer Science · #Advanced Data Compression Techniques #Parallel Computing and Optimization Techniques #Advanced Data Storage Technologies
5. EvoMoE: An Evolutional Mixture-of-Experts Training Framework via Dense-To-Sparse Gate
   2021/12/29 by Xiaonan Nie, Xupeng Miao, Nie, Xiaonan +17 · 3 citations
   Computer Science · #Expert finding and Q&A systems #Domain Adaptation and Few-Shot Learning #Mobile Crowdsensing and Crowdsourcing
6. SeerAttention-R: Sparse Attention Adaptation for Long Reasoning
   2025/06/10 by Shuming Guo, Gao, Yizhao, Guo, Shuming +24 · 10 citations
   Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
7. Bitnet.cpp: Efficient Edge Inference for Ternary LLMs
   2025/02/17 by Jinheng Wang, Wang, Jinheng, Ting Song +16 · 8 citations
   Computer Science · Engineering · #Advanced Data Storage Technologies #Advanced Data and IoT Technologies #Advanced Steganography and Watermarking Techniques #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
8. Adam Accumulation to Reduce Memory Footprints of both Activations and Gradients for Large-scale DNN Training
   2023/05/31 by Yijia Zhang, Zhang, Yijia, Yibo Han +13 · 2 citations
   Computer Science · Engineering · #Advanced Neural Network Applications #Stochastic Gradient Optimization Techniques #Ferroelectric and Negative Capacitance Devices
9. Accurate and Structured Pruning for Efficient Automatic Speech Recognition
   2023/05/31 by Huiqiang Jiang, Jiang, Huiqiang, Li Lyna Zhang +17 · 2 citations
   Computer Science · #Speech Recognition and Synthesis #Music and Audio Processing #Natural Language Processing Techniques
10. HySparse: A Hybrid Sparse Attention Architecture with Oracle Token Selection and KV Cache Sharing
    2026/02/03 by Yizhao Gao, Jianyu Wei, Qihao Zhang +11 · 1 voice
    #cs.CL #cs.AI
11. Integer or Floating Point? New Outlooks for Low-Bit Quantization on Large Language Models
    2023/05/21 by Yijia Zhang, Lingran Zhao, Zhang, Yijia +15 · 1 citation
    Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
12. Biological and pharmacological effects of hexahydrocurcumin, a metabolite of curcumin
    2018/03/27 by Yiyuan Huang, Shijie Cao, Qiang Zhang +4 · 23 citations
    Biochemistry, Genetics and Molecular Biology · Medicine · #Curcumin's Biomedical Applications #Natural product bioactivities and synthesis #Pharmacological Effects of Medicinal Plants
13. Automating Energy-Efficient GPU Kernel Generation: A Fast Search-Based Compilation Approach
    2024/11/28 by Yijia Zhang, Zhang, Yijia, Zhihong Gou +11 · 1 citation
    Computer Science · #Advanced Neural Network Applications #Parallel Computing and Optimization Techniques #Advanced Image and Video Retrieval Techniques