Xizhou Zhu
- Deformable DETR: Deformable Transformers for End-to-End Object Detection
2020/10/08 by Xizhou Zhu, Zhu, Xizhou, Weijie Su +9 · 293 citations
Computer Science · #Advanced Neural Network Applications #Advanced Image and Video Retrieval Techniques #Domain Adaptation and Few-Shot Learning
- Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling
2024/12/06 by Zhe Chen, Chen, Zhe, Weiyun Wang +86 · 3 voices · 417 citations
Computer Science · Decision Sciences · #Topic Modeling #Scientific Computing and Data Management #Machine Learning and Data Classification
- Planning-oriented Autonomous Driving
2022/12/20 by Yihan Hu, Hu, Yihan, Jiazhi Yang +29 · 189 citations
Computer Science · Decision Sciences · #Semantic Web and Ontologies #Topic Modeling #Data Quality and Management
- How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suites
2024/04/25 by Zhe Chen, Weiyun Wang, Chen, Zhe +59 · 162 citations
Engineering · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Reservoir Engineering and Simulation Methods
- InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutions
2022/11/10 by Wenhai Wang, Wang, Wenhai, Jifeng Dai +21 · 55 citations
Computer Science · Engineering · #Advanced Memory and Neural Computing #Advanced Neural Network Applications #CCD and CMOS Imaging Sensors #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- VisionLLM: Large Language Model is also an Open-Ended Decoder for Vision-Centric Tasks
2023/05/18 by Wenhai Wang, Zhe Chen, Wang, Wenhai +19 · 55 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Natural Language Processing Techniques
- VL-BERT: Pre-training of Generic Visual-Linguistic Representations
2019/08/22 by Weijie Su, Su, Weijie, Xizhou Zhu +11 · 36 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Topic Modeling
- DriveMLM: Aligning Multi-Modal Large Language Models with Behavioral Planning States for Autonomous Driving
2023/12/14 by Wenhai Wang, Cui, Erfei, Wang, Wenhai +15 · 38 citations
Computer Science · #Topic Modeling #Multimodal Machine Learning Applications #Advanced Neural Network Applications
- Enhancing the Reasoning Ability of Multimodal Large Language Models via Mixed Preference Optimization
2024/11/15 by Wei‐Yun Wang, Zhe Chen, Wang, Weiyun +19 · 58 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
- VisionLLM v2: An End-to-End Generalist Multimodal Large Language Model for Hundreds of Vision-Language Tasks
2024/06/12 by Jiannan Wu, Wu, Jiannan, Muyan Zhong +23 · 38 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- Ghost in the Minecraft: Generally Capable Agents for Open-World Environments via Large Language Models with Text-based Knowledge and Memory
2023/05/25 by Xizhou Zhu, Yuntao Chen, Zhu, Xizhou +23 · 20 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques
- The All-Seeing Project V2: Towards General Relation Comprehension of the Open World
2024/02/29 by Weiyun Wang, Yiming Ren, Wang, Weiyun +21 · 20 citations
Computer Science · #Multimodal Machine Learning Applications #Topic Modeling #Advanced Graph Neural Networks
- VisualPRM: An Effective Process Reward Model for Multimodal Reasoning
2025/03/13 by Wei‐Yun Wang, Wang, Weiyun, Zhangwei Gao +26 · 41 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Topic Modeling
- Auto MC-Reward: Automated Dense Reward Design with Large Language Models for Minecraft
2023/12/14 by Hao Li, Li, Hao, Yang Xue +17 · 16 citations
Computer Science · #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Software Engineering Research #Software Testing and Debugging Techniques
- Vision-RWKV: Efficient and Scalable Visual Perception with RWKV-Like Architectures
2024/03/04 by Yuchen Duan, Duan, Yuchen, Wei‐Yun Wang +17 · 16 citations
Computer Science · Engineering · #Advanced Image and Video Retrieval Techniques #CCD and CMOS Imaging Sensors #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Visual Attention and Saliency Detection
- Uni-Perceiver: Pre-training Unified Architecture for Generic Perception for Zero-shot and Few-shot Tasks
2021/12/02 by Xizhou Zhu, Jinguo Zhu, Zhu, Xizhou +13 · 8 citations
Computer Science · Biochemistry, Genetics and Molecular Biology · #Domain Adaptation and Few-Shot Learning #Advanced Neural Network Applications #Cell Image Analysis Techniques
- The All-Seeing Project: Towards Panoptic Visual Recognition and Understanding of the Open World
2023/08/03 by Wei‐Yun Wang, Wang, Weiyun, Min Shi +25 · 10 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- VL-LTR: Learning Class-wise Visual-Linguistic Representation for Long-Tailed Visual Recognition
2021/11/26 by Changyao Tian, Wenhai Wang, Tian, Changyao +7 · 7 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Text
2024/06/12 by Qingyun Li, Zhe Chen, Li, Qingyun +75 · 13 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Handwritten Text Recognition Techniques #Music and Audio Processing #Video Analysis and Summarization
- MMIU: Multimodal Multi-image Understanding for Evaluating Large Vision-Language Models
2024/08/05 by Fanqing Meng, Jin Wang, Meng, Fanqing +21 · 12 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- Efficient Deformable ConvNets: Rethinking Dynamic and Sparse Operator for Vision Applications
2024/01/11 by Yuwen Xiong, Xiong, Yuwen, Zhiqi Li +23 · 8 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences
- Uni-Perceiver v2: A Generalist Model for Large-Scale Vision and Vision-Language Tasks
2022/11/17 by Hao Li, Li, Hao, Jinguo Zhu +19 · 6 citations
Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- ControlLLM: Augment Language Models with Tools by Searching on Graphs
2023/10/26 by Zhaoyang Liu, Liu, Zhaoyang, Zeqiang Lai +18 · 7 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimedia (cs.MM) #Multimodal Machine Learning Applications #Topic Modeling
- InternGPT: Solving Vision-Centric Tasks by Interacting with ChatGPT Beyond Language
2023/05/09 by Zhaoyang Liu, Yinan He, Liu, Zhaoyang +36 · 6 citations
Computer Science · Neuroscience · #AI in Service Interactions #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Tactile and Sensory Interactions
- Deep Feature Flow for Video Recognition
2016/11/23 by Xizhou Zhu, Zhu, Xizhou, Yuwen Xiong +7 · 3 citations
Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Human Pose and Action Recognition
- SynerGen-VL: Towards Synergistic Image Understanding and Generation with Vision Experts and Token Folding
2024/12/12 by Hao Li, Changyao Tian, Li, Hao +19 · 11 citations
Computer Science · #Image Retrieval and Classification Techniques #Advanced Image and Video Retrieval Techniques
- Deformable Kernels: Adapting Effective Receptive Fields for Object Deformation
2019/10/07 by Hang Gao, Xizhou Zhu, Gao, Hang +5 · 2 citations
Computer Science · Engineering · #3D Shape Modeling and Analysis #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition
- Towards High Performance Video Object Detection for Mobiles
2018/04/16 by Xizhou Zhu, Jifeng Dai, Zhu, Xizhou +7 · 3 citations
Computer Science · #Advanced Neural Network Applications #Advanced Image and Video Retrieval Techniques #Visual Attention and Saliency Detection
- HoVLE: Unleashing the Power of Monolithic Vision-Language Models with Holistic Vision-Language Embedding
2024/12/20 by Chenxin Tao, Shiqian Su, Tao, Chenxin +18 · 3 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Parameter-Inverted Image Pyramid Networks for Visual Perception and Multimodal Understanding
2025/01/14 by Zhaokai Wang, Xizhou Zhu, Wang, Zhaokai +19 · 2 citations
Computer Science · Engineering · #Advanced Image and Video Retrieval Techniques #Image Retrieval and Classification Techniques #Advanced Image Fusion Techniques
- Mono-InternVL-1.5: Towards Cheaper and Faster Monolithic Multimodal Large Language Models
2025/07/16 by Gen Luo, Wenhan Dou, Luo, Gen +21 · 4 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling