Zechun Liu

1. MobileLLM: Optimizing Sub-billion Parameter Language Models for On-Device Use Cases
   2024/02/22 by Zechun Liu, Changsheng Zhao, Liu, Zechun +21 · 3 voices · 42 citations
   Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #cs.AI #cs.CL #cs.LG
2. Neural Computers
   2026/04/07 by Mingchen Zhuge, Changsheng Zhao, Haozhe Liu +16 · 11 voices
   #cs.LG #cs.AI
3. MiniGPT-v2: large language model as a unified interface for vision-language multi-task learning
   2023/10/14 by Jun Chen, Deyao Zhu, Chen, Jun +17 · 72 citations
   Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Topic Modeling
4. SpinQuant: LLM quantization with learned rotations
   2024/05/26 by Zechun Liu, Liu, Zechun, Changsheng Zhao +15 · 85 citations
   Computer Science · #Advanced Data Compression Techniques #Algorithms and Data Compression
5. LLM-FP4: 4-Bit Floating-Point Quantized Transformers
   2023/01/01 by Shih-Yang Liu, Shih-yang Liu, Zechun Liu +4 · 1 voice · 8 citations
   Computer Science · #Topic Modeling #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning
6. LongVU: Spatiotemporal Adaptive Compression for Long Video-Language Understanding
   2024/10/22 by Xiaoqian Shen, Shen, Xiaoqian, Yunyang Xiong +31 · 78 citations
   Computer Science · #Advanced Data Compression Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Video Analysis and Summarization
7. LLM-QAT: Data-Free Quantization Aware Training for Large Language Models
   2023/05/29 by Zechun Liu, Liu, Zechun, Barlas Oğuz +15 · 32 citations
   Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
8. An Introduction to Vision-Language Modeling
   2024/05/27 by Florian Bordes, Richard Yuanzhe Pang, Bordes, Florian +79 · 39 citations
   Social Sciences · #FOS: Computer and information sciences #Geographic Information Systems Studies #Machine Learning (cs.LG)
9. Single Path One-Shot Neural Architecture Search with Uniform Sampling
   2019/03/31 by Zichao Guo, Guo, Zichao, Xiangyu Zhang +11 · 24 citations
   Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences
10. Bi-Real Net: Enhancing the Performance of 1-bit CNNs With Improved Representational Capability and Advanced Training Algorithm
    2018/08/01 by Zechun Liu, Baoyuan Wu, Liu, Zechun +9 · 16 citations
    Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Anomaly Detection Techniques and Applications
11. Llama Guard 3-1B-INT4: Compact and Efficient Safeguard for Human-AI Conversations
    2024/11/18 by Igor Fedorov, Kate Plawiak, Fedorov, Igor +37 · 2 voices · 5 citations
    #cs.DC #cs.AI
12. Nonuniform-to-Uniform Quantization: Towards Accurate Quantization via Generalized Straight-Through Estimation
    2021/11/29 by Zechun Liu, Kwang‐Ting Cheng, Liu, Zechun +7 · 8 citations
    Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Image Enhancement Techniques #Machine Learning (cs.LG)
13. ReActNet: Towards Precise Binary Neural Network with Generalized Activation Functions
    2020/03/07 by Zechun Liu, Liu, Zechun, Zhiqiang Shen +5 · 6 citations
    Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #FOS: Electrical engineering #Image and Video Processing (eess.IV) #Machine Learning (cs.LG) #Machine Learning and ELM #electronic engineering #information engineering
14. Efficient Track Anything
    2024/11/28 by Yunyang Xiong, Chong Zhou, Xiong, Yunyang +23 · 3 voices · 7 citations
    #cs.CV
15. BiT: Robustly Binarized Multi-distilled Transformer
    2022/05/25 by Zechun Liu, Liu, Zechun, Barlas Oğuz +13 · 4 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
16. Latent Weights Do Not Exist: Rethinking Binarized Neural Network Optimization
    2019/06/05 by Koen Helwegen, Helwegen, Koen, James Widdicombe +9 · 2 citations
    Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
17. Is Label Smoothing Truly Incompatible with Knowledge Distillation: An\n Empirical Study
    2021/04/01 by Zhiqiang Shen, Shen, Zhiqiang, Zechun Liu +9 · 2 citations
    Computer Science · #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification
18. ParetoQ: Improving Scaling Laws in Extremely Low-bit LLM Quantization
    2025/02/04 by Zechun Liu, Changsheng Zhao, Liu, Zechun +28 · 5 citations
    Physics and Astronomy · Computer Science · #Particle Detector Development and Performance #Atomic and Subatomic Physics Research #Advanced Data Compression Techniques
19. The Path Not Taken: RLVR Provably Learns Off the Principals
    2025/11/11 by Hanqing Zhu, Zhenyu Zhang, Zhu, Hanqing +26 · 1 voice · 6 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Reinforcement Learning in Robotics #Topic Modeling #cs.AI #cs.LG
20. R-Sparse: Rank-Aware Activation Sparsity for Efficient LLM Inference
    2025/04/28 by Zhenyu Zhang, Zhang, Zhenyu, Zechun Liu +9 · 5 citations
    Computer Science · Materials Science · #Topic Modeling #Advanced Neural Network Applications #Machine Learning in Materials Science
21. Bi-Real Net: Binarizing Deep Network Towards Real-Network Performance
    2018/11/04 by Zechun Liu, Wenhan Luo, Liu, Zechun +9 · 1 citation
    Computer Science · Engineering · #Advanced Vision and Imaging #Image Enhancement Techniques #Image Processing Techniques and Applications
22. Vision Transformer Slimming: Multi-Dimension Searching in Continuous Optimization Space
    2022/01/03 by Arnav Chavan, Zhiqiang Shen, Chavan, Arnav +9 · 1 citation
    Computer Science · #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #Advanced Vision and Imaging #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
23. SCALES: Boost Binary Neural Network for Image Super-Resolution with Efficient Scalings
    2023/03/22 by Renjie Wei, Wei, Renjie, Zechun Liu +9 · 1 citation
    Computer Science · Engineering · #Advanced Image Processing Techniques #Advanced Vision and Imaging #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Image and Video Processing (eess.IV) #Photoacoustic and Ultrasonic Imaging #electronic engineering #information engineering
24. Mixture-of-Supernets: Improving Weight-Sharing Supernet Training with Architecture-Routed Mixture-of-Experts
    2023/06/08 by Ganesh Jawahar, Haichuan Yang, Jawahar, Ganesh +23 · 1 citation
    Computer Science · Engineering · #Advanced Neural Network Applications #Ferroelectric and Negative Capacitance Devices #Adversarial Robustness in Machine Learning