Kaipeng Zhang
- Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling
2024/12/06 by Zhe Chen, Weiyun Wang, Chen, Zhe +86 · 3 voices · 419 citations
Computer Science · Decision Sciences · #Topic Modeling #Scientific Computing and Data Management #Machine Learning and Data Classification
- Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks
2016/10/01 by Kaipeng Zhang, Zhanpeng Zhang, Zhifeng Li +1 · 38 citations
- OmniQuant: Omnidirectionally Calibrated Quantization for Large Language Models
2023/08/25 by Wenqi Shao, Shao, Wenqi, Mengzhao Chen +17 · 59 citations
Computer Science · #Topic Modeling #Speech Recognition and Synthesis
- MMT-Bench: A Comprehensive Multimodal Benchmark for Evaluating Large Vision-Language Models Towards Multitask AGI
2024/04/24 by Kaining Ying, Ying, Kaining, Fanqing Meng +40 · 45 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Image Retrieval and Classification Techniques #Multimodal Machine Learning Applications
- LVLM-eHub: A Comprehensive Evaluation Benchmark for Large Vision-Language Models
2023/06/15 by Peng Xu, Xu, Peng, Wenqi Shao +17 · 32 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning
2025/03/10 by Fanqing Meng, Meng, Fanqing, Lingxiao Du +27 · 59 citations
Computer Science · #Advanced Graph Neural Networks #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Topic Modeling
- OneLLM: One Framework to Align All Modalities with Language
2023/12/06 by Jiaming Han, Han, Jiaming, Kaixiong Gong +15 · 25 citations
Computer Science · #Multimodal Machine Learning Applications #Topic Modeling #Natural Language Processing Techniques
- Lumina-Next: Making Lumina-T2X Stronger and Faster with Next-DiT
2024/06/05 by Le Zhuo, Zhuo, Le, Ruoyi Du +41 · 31 citations
Computer Science · Physics and Astronomy · #Generative Adversarial Networks and Image Synthesis #Music Technology and Sound Studies #Model Reduction and Neural Networks
- EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
2024/07/10 by Mengzhao Chen, Wenqi Shao, Chen, Mengzhao +11 · 29 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Speech Recognition and Synthesis
- Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generation
2024/10/07 by Fanqing Meng, Jiaqi Liao, Meng, Fanqing +17 · 28 citations
Computer Science · Engineering · #Computer Graphics and Visualization Techniques #Embedded Systems Design Techniques #Human Motion and Animation
- DiffRate : Differentiable Compression Rate for Efficient Vision Transformers
2023/05/29 by Mengzhao Chen, Chen, Mengzhao, Wenqi Shao +15 · 11 citations
Computer Science · #Advanced Neural Network Applications #Advanced Image and Video Retrieval Techniques #Visual Attention and Saliency Detection
- SPHINX-X: Scaling Data and Parameters for a Family of Multi-modal Large Language Models
2024/02/08 by Liu, Dongyang, Renrui Zhang, Zhang, Renrui +34 · 11 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- MMIU: Multimodal Multi-image Understanding for Evaluating Large Vision-Language Models
2024/08/05 by Fanqing Meng, Jin Wang, Meng, Fanqing +21 · 12 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- ZipVL: Efficient Large Vision-Language Models with Dynamic Token Sparsification
2024/10/11 by Yefei He, He, Yefei, Feng Chen +11 · 12 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Image Retrieval and Classification Techniques #Multimodal Machine Learning Applications
- BESA: Pruning Large Language Models with Blockwise Parameter-Efficient Sparsity Allocation
2024/02/18 by Peng Xu, Wenqi Shao, Xu, Peng +15 · 7 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Speech Recognition and Synthesis
- OpenING: A Comprehensive Benchmark for Judging Open-ended Interleaved Image-Text Generation
2024/11/27 by Pengfei Zhou, Zhou, Pengfei, Xiaopeng Peng +33 · 11 citations
Computer Science · Health Professions · #Multimodal Machine Learning Applications #Video Analysis and Summarization #Digital Storytelling and Education
- SearchLVLMs: A Plug-and-Play Framework for Augmenting Large Vision-Language Models by Searching Up-to-Date Internet Knowledge
2024/05/23 by Chuanhao Li, Li, Chuanhao, Zhen Li +15 · 6 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- PyVision: Agentic Vision with Dynamic Tooling
2025/07/10 by Shitian Zhao, Haoquan Zhang, Zhao, Shitian +10 · 20 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Data Visualization and Analytics #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- Dynamic Multimodal Evaluation with Flexible Complexity by Vision-Language Bootstrapping
2024/10/11 by Yue Yang, Shuibai Zhang, Yang, Yue +11 · 8 citations
Computer Science · #Speech and dialogue systems #Natural Language Processing Techniques
- Think or Not Think: A Study of Explicit Thinking in Rule-Based Visual Reinforcement Fine-Tuning
2025/03/20 by Hongran Li, Jike Zhong, Li, Ming +10 · 11 citations
Business, Management and Accounting · Engineering · Neuroscience · #Computer Vision and Pattern Recognition (cs.CV) #Design Education and Practice #FOS: Computer and information sciences #Product Development and Customization #Tactile and Sensory Interactions
- Yume: An Interactive World Generation Model
2025/07/23 by Xuehui Mao, Mao, Xiaofeng, Zhen Li +15 · 14 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Motion and Animation #Human-Computer Interaction (cs.HC) #Video Analysis and Summarization
- TagCLIP: A Local-to-Global Framework to Enhance Open-Vocabulary Multi-Label Classification of CLIP Without Training
2023/12/20 by Yuqi Lin, Minghao Chen, Lin, Yuqi +17 · 3 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Text and Document Classification Technologies #Topic Modeling
- MLLMs-Augmented Visual-Language Representation Learning
2023/11/30 by Yanqing Liu, Liu, Yanqing, Kai Wang +13 · 3 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques
- OmniWorld: A Multi-Domain and Multi-Modal Dataset for 4D World Modeling
2025/09/15 by Yang Zhou, Y. Q. Wang, Zhou, Yang +35 · 8 citations
Engineering · Environmental Science · #3D Modeling in Geospatial Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Remote Sensing and LiDAR Applications
- ZipAR: Parallel Auto-regressive Image Generation through Spatial Locality
2024/12/05 by Yefei He, He, Yefei, Feng Chen +11 · 4 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #Medical Image Segmentation Techniques
- SridBench: Benchmark of Scientific Research Illustration Drawing of Image Generation Model
2025/05/28 by Yifan Chang, Chang, Yifan, Yulong Feng +11 · 6 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Data Visualization and Analytics #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Multimodal Machine Learning Applications
- Improving Autoregressive Image Generation through Coarse-to-Fine Token Prediction
2025/03/20 by Ziyao Guo, Kaipeng Zhang, Guo, Ziyao +3 · 5 citations
Computer Science · Engineering · #Advanced Image and Video Retrieval Techniques #Advanced Vision and Imaging #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Image Processing Techniques and Applications
- Bootstrap Model Ensemble and Rank Loss for Engagement Intensity Regression
2019/07/08 by Kai Wang, Jianfei Yang, Wang, Kai +9 · 1 citation
Computer Science · Psychology · #Computer Vision and Pattern Recognition (cs.CV) #Emotion and Mood Recognition #FOS: Computer and information sciences #Gaze Tracking and Assistive Technology #Human Pose and Action Recognition
- DiffAgent: Fast and Accurate Text-to-Image API Selection with Large Language Model
2024/03/31 by Lirui Zhao, Yang Yue, Zhao, Lirui +13 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Sentiment Analysis and Opinion Mining #Text and Document Classification Technologies #Web Data Mining and Analysis
- LeX-Art: Rethinking Text Generation via Scalable High-Quality Data Synthesis
2025/03/27 by Shitian Zhao, Qilong Wu, Zhao, Shitian +23 · 3 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Image Processing and 3D Reconstruction #Mathematics, Computing, and Information Processing #Natural Language Processing Techniques
- TIR-Bench: A Comprehensive Benchmark for Agentic Thinking-with-Images Reasoning
2025/11/03 by Miao Li, Li, Ming, Jike Zhong +14 · 5 citations
Computer Science · Psychology · #Computer Vision and Pattern Recognition (cs.CV) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Language, Metaphor, and Cognition #Multimodal Machine Learning Applications
- DREAM+: Efficient Dataset Distillation by Bidirectional Representative Matching
2023/10/23 by Yanqing Liu, Liu, Yanqing, Jianyang Gu +11 · 1 citation
Computer Science · #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences
- Yume-1.5: A Text-Controlled Interactive World Generation Model
2025/12/26 by Xuehui Mao, Mao, Xiaofeng, Zhen Li +15 · 3 citations
Computer Science · Engineering · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Human Motion and Animation #Multimodal Machine Learning Applications
- Rethinking Human Evaluation Protocol for Text-to-Video Models: Enhancing Reliability,Reproducibility, and Practicality
2024/06/13 by Tianle Zhang, Zhang, Tianle, Langtian Ma +21 · 1 citation
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #User Authentication and Security Systems
- Neural-Driven Image Editing
2025/07/07 by Pengfei Zhou, Zhou, Pengfei, Jie Xia +33 · 1 voice · 2 citations
Computer Science · Neuroscience · #EEG and Brain-Computer Interfaces #Face Recognition and Perception #Multimodal Machine Learning Applications #cs.CV
- MDK12-Bench: A Comprehensive Evaluation of Multimodal Large Language Models on Multidisciplinary Exams
2025/08/09 by Pengfei Zhou, Zhou, Pengfei, Peng, Xiaopeng +37 · 3 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computers and Society (cs.CY) #FOS: Computer and information sciences #Intelligent Tutoring Systems and Adaptive Learning #Multimodal Machine Learning Applications #Topic Modeling
- SVBench: Evaluation of Video Generation Models on Social Reasoning
2025/12/25 by Wenshuo Peng, Peng, Wenshuo, Gongxuan Wang +11 · 1 citation
Computer Science · Psychology · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Multimodal Machine Learning Applications #Social Robot Interaction and HRI
- Generative World Renderer at the Speed of Play
2026/07/21 by Guixu Lin, Zheng-Hui Huang, Siqi Yang +3
#cs.CV
- Surprise Forcing: What to Remember, When to Skip in Long Video Generation
2026/07/20 by Shuwei Shi, Zhen Li, Muyao Niu +4
#cs.CV
- AlayaWorld: Interactive Long-Horizon World Modeling -- Full Technical Report
2026/07/20 by AlayaWorld Team, Kaipeng Zhang, Chuanhao Li +15
#cs.AI
- ShadowDancer: Teaching Video World Models Any Action by Learning Unified Dynamics Representations from a Video and Its Shadow
2026/07/30 by Jin Cao, Zian Meng, Kaipeng Zhang
Computer Science · #cs.CV #cs.AI #cs.LG
- Evidence-Grounded AI for Musculoskeletal Care
2026/07/14 by Wenjie Li, Yujie Zhang, Fanrui Zhang +34
#cs.AI