Haotian Liu
- Visual Instruction Tuning
2023/04/17 by Haotian Liu, Liu, Haotian, Chunyuan Li +5 · 1361 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques
- Improved Baselines with Visual Instruction Tuning
2023/10/05 by Haotian Liu, Chunyuan Li, Liu, Haotian +5 · 728 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques
- LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Day
2023/06/01 by Chunyuan Li, Li, Chunyuan, Cliff Wong +15 · 242 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs
2024/06/26 by Zirui Wang, Mengzhou Xia, Wang, Zirui +23 · 1 voice · 76 citations
Arts and Humanities · Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Lexicography and Language Studies #Mathematics, Computing, and Information Processing #Natural Language Processing Techniques #cs.CL #cs.CV
- GLIGEN: Open-Set Grounded Text-to-Image Generation
2023/01/17 by Yuheng Li, Haotian Liu, Li, Yuheng +13 · 100 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Graphics (cs.GR) #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- Aligning Large Multimodal Models with Factually Augmented RLHF
2023/09/25 by Zhiqing Sun, Sun, Zhiqing, Sheng Shen +21 · 111 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Text Readability and Simplification #Topic Modeling
- LLaVA-Plus: Learning to Use Tools for Creating Multimodal Agents
2023/11/09 by Shilong Liu, Liu, Shilong, Hao Cheng +23 · 1 voice · 43 citations
#cs.CV #cs.AI #cs.CL #cs.LG #cs.MM
- ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts
2023/12/01 by Mu Cai, Cai, Mu, Haotian Liu +11 · 34 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Advanced Image and Video Retrieval Techniques
- Learning Customized Visual Models with Retrieval-Augmented Knowledge
2023/01/17 by Haotian Liu, Liu, Haotian, Kilho Son +11 · 13 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Models
2022/04/19 by Chunyuan Li, Li, Chunyuan, Haotian Liu +19 · 11 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Advanced Neural Network Applications
- An Empirical Study of Scaling Instruct-Tuned Large Multimodal Models
2023/09/18 by Yadong Lu, Chunyuan Li, Lu, Yadong +9 · 4 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Generalizable Face Landmarking Guided by Conditional Face Warping
2024/04/18 by Jiayi Liang, Liang, Jiayi, Haotian Liu +5 · 3 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Face and Expression Recognition #Face recognition and analysis
- Carrier Aggregation Enabled MIMO-OFDM Integrated Sensing and Communication
2024/05/17 by Haotian Liu, Zhiqing Wei, Liu, Haotian +9 · 3 citations
Engineering · #FOS: Electrical engineering #Satellite Communication Systems #Signal Processing (eess.SP) #electronic engineering #information engineering
- Deep Cooperation in ISAC System: Resource, Node and Infrastructure Perspectives
2024/03/05 by Zhiqing Wei, Wei, Zhiqing, Haotian Liu +10 · 2 citations
Computer Science · #FOS: Electrical engineering #IoT and Edge/Fog Computing #Signal Processing (eess.SP) #electronic engineering #information engineering
- PCDepth: Pattern-based Complementary Learning for Monocular Depth Estimation by Best of Both Worlds
2024/02/29 by Haotian Liu, Liu, Haotian, Sanqing Qu +11 · 2 citations
Engineering · Computer Science · #Industrial Vision Systems and Defect Detection #Optical measurement and interference techniques #Advanced Vision and Imaging
- RL2: Reinforce Large Language Model to Assist Safe Reinforcement Learning for Energy Management of Active Distribution Networks
2024/12/02 by Yang Xu, Yang, Xu, Chenhui Lin +5 · 4 citations
Engineering · #Smart Grid Security and Resilience #Smart Grid Energy Management #Electricity Theft Detection Techniques
- Learning an Effective Premise Retrieval Model for Efficient Mathematical Formalization
2025/01/21 by Yicheng Tao, Tao, Yicheng, Haotian Liu +5 · 2 citations
Computer Science · #Mathematics, Computing, and Information Processing #Intelligent Tutoring Systems and Adaptive Learning
- Generate Anything Anywhere in Any Scene
2023/06/29 by Yuheng Li, Li, Yuheng, Haotian Liu +6 · 1 voice
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Image Retrieval and Classification Techniques #cs.CV
- Protecting residential electrical panels and service through model predictive control: A field study
2024/09/07 by Elias N. Pergantis, Levi D. Reyes Premer, Pergantis, Elias N. +12 · 1 voice · 2 citations
Engineering · #FOS: Electrical engineering #Systems and Control (eess.SY) #eess.SY #electronic engineering #information engineering
- Multipath Component-Aided Signal Processing for Integrated Sensing and Communication Systems
2024/12/31 by Haotian Liu, Zhiqing Wei, Liu, Haotian +11 · 1 citation
Computer Science · #Sensor Technology and Measurement Systems
- Removing Distributional Discrepancies in Captions Improves Image-Text Alignment
2024/10/01 by Yuheng Li, Li, Yuheng, Haotian Liu +13 · 1 citation
Arts and Humanities · Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Subtitles and Audiovisual Media #Video Analysis and Summarization
- Hyperbolic Chamfer Distance for Point Cloud Completion and Beyond
2024/12/23 by Fangzhou Lin, Songlin Hou, Lin, Fangzhou +11 · 1 citation
Engineering · Computer Science · #3D Shape Modeling and Analysis #Computer Graphics and Visualization Techniques #Computational Geometry and Mesh Generation
- AlayaDB: The Data Foundation for Efficient and Effective Long-context LLM Inference
2025/04/14 by Yangshen Deng, Deng, Yangshen, Zhengxin You +28 · 1 citation
Computer Science · #Advanced Computational Techniques and Applications #Artificial Intelligence (cs.AI) #Databases (cs.DB) #FOS: Computer and information sciences #H.3.1 #H.3.2 #H.3.3 #H.3.4 #Information Retrieval (cs.IR)
- Efficient and Effective In-place Graph-based Vector Index Updates
2026/07/17 by Haotian Liu, Yujun He, Bo Tang
#cs.DB #cs.IR
- Skill Self-Play: Pushing the Frontier of LLM Capability with Co-Evolving Skills
2026/07/24 by Siyuan Huang, Pengyu Cheng, Haotian Liu +10
#cs.CL
- DMSNet: Cross-Band Learning for Multi-Target Sensing in Multi-Band ISAC
2026/07/20 by Haotian Liu, Zhiqing Wei, Quanjiang Zhao +4
#eess.SP