Qingru Zhang
- AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning
2023/03/18 by Qingru Zhang, Minshuo Chen, Zhang, Qingru +12 · 105 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- GEAR: An Efficient KV Cache Compression Recipe for Near-Lossless Generative Inference of LLM
2024/03/08 by Hao Kang, Qingru Zhang, Kang, Hao +11 · 19 citations
Computer Science · #Advanced Data Storage Technologies #Algorithms and Data Compression #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Network Packet Processing and Optimization
- LoSparse: Structured Compression of Large Language Models based on Low-Rank and Sparse Approximation
2023/06/20 by Yixiao Li, Yifan Yu, Li, Yixiao +11 · 14 citations
Computer Science · Mathematics · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Tensor decomposition and applications #Topic Modeling
- Less is More: Task-aware Layer-wise Distillation for Language Model Compression
2022/10/04 by Liang Chen, Liang, Chen, Simiao Zuo +9 · 9 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Tell Your Model Where to Attend: Post-hoc Attention Steering for LLMs
2023/11/03 by Qingru Zhang, Zhang, Qingru, Chandan Singh +11 · 7 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- Robust Multi-Agent Reinforcement Learning via Adversarial Regularization: Theoretical Foundation and Stable Algorithms
2023/10/16 by Alexander Bukharin, Yan Li, Bukharin, Alexander +15 · 7 citations
Computer Science · Engineering · #Adversarial Robustness in Machine Learning #Electrostatic Discharge in Electronics
- Robust Reinforcement Learning from Corrupted Human Feedback
2024/06/21 by Alexander Bukharin, Ilgee Hong, Bukharin, Alexander +10 · 6 citations
Computer Science · #Neural Networks and Applications
- Efficient Long-Range Transformers: You Need to Attend More, but Not Necessarily at Every Layer
2023/10/19 by Qingru Zhang, Zhang, Qingru, Dhananjay Ram +7 · 3 citations
Computer Science · #Advanced Neural Network Applications #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation
2022/04/15 by Simiao Zuo, Qingru Zhang, Zuo, Simiao +9 · 1 citation
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- Think-RM: Enabling Long-Horizon Reasoning in Generative Reward Models
2025/05/22 by Ilgee Hong, Changlong Yu, Hong, Ilgee +19 · 4 citations
Computer Science · #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Topic Modeling
- Model Tells Itself Where to Attend: Faithfulness Meets Automatic Attention Steering
2024/09/16 by Qingru Zhang, Xiaodong Yu, Zhang, Qingru +15 · 1 citation
Neuroscience · Social Sciences · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Mind wandering and attention #Religion, Spirituality, and Psychology
- Win Fast or Lose Slow: Balancing Speed and Accuracy in Latency-Sensitive Decisions of LLMs
2025/05/26 by Hao Kang, Kang, Hao, Qingru Zhang +11 · 2 citations
Business, Management and Accounting · Computer Science · #Artificial Intelligence (cs.AI) #Business Process Modeling and Analysis #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multiagent Systems (cs.MA) #Parallel #Semantic Web and Ontologies #and Cluster Computing (cs.DC)