Zhao, Weilin

1. MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies
   2024/04/09 by Shengding Hu, Yuge Tu, Hu, Shengding +48 · 2 voices · 135 citations
   Computer Science · #Natural Language Processing Techniques #Topic Modeling #cs.CL #cs.LG
2. MiniCPM-V: A GPT-4V Level MLLM on Your Phone
   2024/08/03 by Yuan Yao, Tianyou Yu, Yao, Yuan +41 · 224 citations
   Computer Science · #Advanced Data Storage Technologies #Algorithms and Data Compression #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
3. Tool Learning with Foundation Models
   2023/04/17 by Yujia Qin, Shengding Hu, Qin, Yujia +79 · 51 citations
   Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Mobile Crowdsensing and Crowdsourcing #Software Engineering Research
4. Densing Law of LLMs
   2024/12/05 by Chaojun Xiao, Xiao, Chaojun, Jie Cai +17 · 8 voices · 12 citations
   Business, Management and Accounting · Social Sciences · #Corporate Governance and Law #European and International Contract Law #Corporate Insolvency and Governance
5. Delta Tuning: A Comprehensive Study of Parameter Efficient Methods for Pre-trained Language Models
   2022/03/14 by Ding, Ning, Qin, Yujia, Yang, Guang +17 · 9 citations
   #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
6. OpenPrompt: An Open-source Framework for Prompt-learning
   2021/11/03 by Ning Ding, Ding, Ning, Shengding Hu +11 · 6 citations
   Computer Science · #Topic Modeling #Natural Language Processing Techniques #Text Readability and Simplification
7. PTR: Prompt Tuning with Rules for Text Classification
   2021/05/24 by Xu Han, Han, Xu, Weilin Zhao +7 · 8 citations
   Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
8. Predicting Emergent Abilities with Infinite Resolution Evaluation
   2023/10/05 by Hu, Shengding, Liu, Xin, Han, Xu +9 · 7 citations
   #Computation and Language (cs.CL) #FOS: Computer and information sciences
9. Ouroboros: Generating Longer Drafts Phrase by Phrase for Faster Speculative Decoding
   2024/02/21 by Zhao, Weilin, Huang, Yuxiang, Han, Xu +7 · 8 citations
   #Computation and Language (cs.CL) #FOS: Computer and information sciences
10. Beyond the Turn-Based Game: Enabling Real-Time Conversations with Duplex Models
    2024/06/22 by Xinrong Zhang, Zhang, Xinrong, Yingfa Chen +15 · 9 citations
    Psychology · #Educational Games and Gamification
11. MiniCPM4: Ultra-Efficient LLMs on End Devices
    2025/06/09 by MiniCPM Team, Chaojun Xiao, Xiao, Chaojun +148 · 22 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
12. Configurable Foundation Models: Building LLMs from a Modular Perspective
    2024/09/04 by Chaojun Xiao, Xiao, Chaojun, Zhengyan Zhang +43 · 4 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Semantic Web and Ontologies
13. FR-Spec: Accelerating Large-Vocabulary Language Models via Frequency-Ranked Speculative Sampling
    2025/02/20 by Weilin Zhao, Zhao, Weilin, Xu Han +20 · 6 citations
    Computer Science · #Natural Language Processing Techniques #Topic Modeling #Speech Recognition and Synthesis
14. Enabling Real-Time Conversations with Minimal Training Costs
    2024/09/18 by Wang Xu, Xu, Wang, Shuo Wang +15 · 4 citations
    Computer Science · Psychology · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Innovative Teaching and Learning Methods #Intelligent Tutoring Systems and Adaptive Learning
15. InfLLM-V2: Dense-Sparse Switchable Attention for Seamless Short-to-Long Adaptation
    2025/09/29 by Weilin Zhao, Zhao, Weilin, Zihan Zhou +22 · 8 citations
    Computer Science · #Human Pose and Action Recognition #Video Surveillance and Tracking Methods #Domain Adaptation and Few-Shot Learning
16. OpenDelta: A Plug-and-play Library for Parameter-efficient Adaptation of Pre-trained Models
    2023/07/05 by Hu, Shengding, Ding, Ning, Zhao, Weilin +4 · 1 citation
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
17. Seq1F1B: Efficient Sequence-Level Pipeline Parallelism for Large Language Model Training
    2024/06/05 by Sun, Ao, Zhao, Weilin, Han, Xu +5 · 2 citations
    #Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
18. CA-LoRA: Adapting Existing LoRA for Compressed LLMs to Enable Efficient Multi-Tasking on Personal Devices
    2023/07/15 by Weilin Zhao, Zhao, Weilin, Yuxiang Huang +11 · 1 citation
    Computer Science · Engineering · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Speech Recognition and Synthesis #Topic Modeling
19. BurstAttention: An Efficient Distributed Attention Framework for Extremely Long Sequences
    2024/03/14 by Sun Ao, Sun, Ao, Weilin Zhao +11 · 1 citation
    Computer Science · Mathematics · #Advanced Data Compression Techniques #Algorithms and Data Compression #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Tensor decomposition and applications #and Cluster Computing (cs.DC)
20. BurstEngine: an Efficient Distributed Framework for Training Transformers on Extremely Long Sequences of over 1M Tokens
    2025/09/24 by Sun, Ao, Zhao, Weilin, Han, Xu +4 · 2 citations
    #Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
21. BlockFFN: Towards End-Side Acceleration-Friendly Mixture-of-Experts with Chunk-Level Activation Sparsity
    2025/07/11 by Song, Chenyang, Zhao, Weilin, Han, Xu +5 · 1 citation
    #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
22. NOSA: Native and Offloadable Sparse Attention
    2025/10/15 by Yuxiang Huang, Wang, Pengjie, Huang, Yuxiang +10 · 1 citation
    Computer Science · Engineering · Medicine · #Artificial Intelligence (cs.AI) #COVID-19 diagnosis using AI #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics and Automated Systems #Seismology and Earthquake Studies