Kong, Zhenglun
- SPViT: Enabling Faster Vision Transformers via Soft Token Pruning
2021/12/27 by Kong, Zhenglun, Dong, Peiyan, Ma, Xiaolong +9 · 24 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Hardware Architecture (cs.AR) #Machine Learning (cs.LG)
- You Need Multiple Exiting: Dynamic Early Exiting for Accelerating Unified Vision Language Model
2022/11/21 by Shengkun Tang, Yaqing Wang, Tang, Shengkun +15 · 9 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- HeatViT: Hardware-Efficient Adaptive Token Pruning for Vision Transformers
2022/11/15 by Peiyan Dong, Mengshu Sun, Dong, Peiyan +19 · 8 citations
Computer Science · Engineering · Neuroscience · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Brain Tumor Detection and Classification #CCD and CMOS Imaging Sensors #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Hardware Architecture (cs.AR)
- TxAgent: An AI Agent for Therapeutic Reasoning Across a Universe of Tools
2025/03/14 by Shanghua Gao, Richard Zhu, Gao, Shanghua +13 · 20 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Artificial Intelligence (cs.AI) #Biomedical Text Mining and Ontologies #FOS: Computer and information sciences #Genomics and Rare Diseases #Machine Learning (cs.LG) #Machine Learning in Healthcare
- Agile-Quant: Activation-Guided Quantization for Faster Inference of LLMs on the Edge
2023/12/09 by Xuan Shen, Peiyan Dong, Shen, Xuan +13 · 8 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- Exploring Token Pruning in Vision State Space Models
2024/09/27 by Zhan, Zheng, Kong, Zhenglun, Gong, Yifan +8 · 12 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- MEST: Accurate and Fast Memory-Economic Sparse Training Framework on the Edge
2021/10/26 by Geng Yuan, Yuan, Geng, Xiaolong Ma +29 · 3 citations
Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and ELM #Neural and Evolutionary Computing (cs.NE) #Stochastic Gradient Optimization Techniques
- Layer Freezing & Data Sieving: Missing Pieces of a Generic Framework for Sparse Training
2022/09/22 by Geng Yuan, Yanyu Li, Yuan, Geng +13 · 3 citations
Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and ELM
- Peeling the Onion: Hierarchical Reduction of Data Redundancy for Efficient Vision Transformer Training
2022/11/19 by Zhenglun Kong, Kong, Zhenglun, Haoyu Ma +27 · 3 citations
Engineering · Computer Science · #Advanced Image Fusion Techniques #CCD and CMOS Imaging Sensors #Image Enhancement Techniques
- Squat: Quant Small Language Models on the Edge
2024/02/16 by Xuan Shen, Shen, Xuan, Peiyan Dong +17 · 4 citations
Computer Science · Engineering · #Advanced Neural Network Applications #Advancements in Photolithography Techniques #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel Computing and Optimization Techniques
- Pruning Foundation Models for High Accuracy without Retraining
2024/10/21 by Zhao, Pu, Sun, Fei, Shen, Xuan +4 · 7 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Token Reduction Should Go Beyond Efficiency in Generative Models -- From Vision, Language to Multimodality
2025/05/23 by Kong, Zhenglun, Li, Yize, Zeng, Fanhu +7 · 10 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Toward Adaptive Large Language Models Structured Pruning via Hybrid-grained Weight Importance Assessment
2024/03/16 by Liu, Jun, Kong, Zhenglun, Zhao, Pu +9 · 5 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Rethinking Token Reduction for State Space Models
2024/10/16 by Zheng Zhan, Yushu Wu, Zhan, Zheng +14 · 5 citations
Decision Sciences · Engineering · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Real-time simulation and control systems #Simulation Techniques and Applications
- Search for Efficient Large Language Models
2024/09/25 by Shen, Xuan, Pu Zhao, Zhao, Pu +16 · 5 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Text and Document Classification Technologies
- Fast and Memory-Efficient Video Diffusion Using Streamlined Inference
2024/11/02 by Zhan, Zheng, Wu, Yushu, Gong, Yifan +7 · 4 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Efficient Transformer-based Large Scale Language Representations using Hardware-friendly Block Structured Pruning
2020/09/17 by Li, Bingbing, Kong, Zhenglun, Zhang, Tianyun +4 · 1 citation
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Quasar-ViT: Hardware-Oriented Quantization-Aware Architecture Search for Vision Transformers
2024/07/25 by Li, Zhengang, Lu, Alec, Xie, Yanyue +9 · 1 citation
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Token Transforming: A Unified and Training-Free Token Compression Framework for Vision Transformer Acceleration
2025/06/06 by Fanhu Zeng, Deli Yu, Zeng, Fanhu +5 · 2 citations
Computer Science · #Advanced Neural Network Applications #Generative Adversarial Networks and Image Synthesis #Advanced Vision and Imaging
- ACE: Exploring Activation Cosine Similarity and Variance for Accurate and Calibration-Efficient LLM Pruning
2025/05/28 by Mi, Zhendong, Kong, Zhenglun, Yuan, Geng +1 · 2 citations
#FOS: Computer and information sciences #I.2.6 #I.2.7 #Machine Learning (cs.LG)
- Structured Agent Distillation for Large Language Model
2025/05/20 by Liu, Jun, Kong, Zhenglun, Dong, Peiyan +10 · 2 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Democratizing AI scientists using ToolUniverse
2025/09/27 by Shanghua Gao, Gao, Shanghua, Richard Zhu +19 · 6 citations
Social Sciences · #Artificial Intelligence (cs.AI) #Ethics and Social Impacts of AI #FOS: Computer and information sciences #Machine Learning (cs.LG)
- RCR-Router: Efficient Role-Aware Context Routing for Multi-Agent LLM Systems with Structured Memory
2025/08/06 by Jun Liu, Liu, Jun, Zhenglun Kong +26 · 3 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- TSLA: A Task-Specific Learning Adaptation for Semantic Segmentation on Autonomous Vehicles Platform
2025/08/17 by Liu, Jun, Kong, Zhenglun, Zhao, Pu +9 · 1 citation
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Hardware Architecture (cs.AR) #Machine Learning (cs.LG)