Xingjian He
- VALOR: Vision-Audio-Language Omni-Perception Pretraining Model and Dataset
2023/04/17 by Jing Liu, Liu, Jing, Sihan Chen +11 · 28 citations
Computer Science · #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Multimedia (cs.MM) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling #electronic engineering #information engineering
- VLAB: Enhancing Video Language Pre-training by Feature Adapting and Blending
2023/05/22 by Xingjian He, He, Xingjian, Sihan Chen +17 · 4 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Topic Modeling
- COSA: Concatenated Sample Pretrained Vision-Language Foundation Model
2023/06/15 by Sihan Chen, Chen, Sihan, Xingjian He +9 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimedia (cs.MM) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Beyond Literal Descriptions: Understanding and Locating Open-World Objects Aligned with Human Intentions
2024/02/17 by Wenxuan Wang, Wang, Wenxuan, Yisi Zhang +11 · 2 citations
Arts and Humanities · Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #Digital Humanities and Scholarship #FOS: Computer and information sciences #Semantic Web and Ontologies #Speech and dialogue systems
- MiniVLN: Efficient Vision-and-Language Navigation by Progressive Knowledge Distillation
2024/09/27 by Junyou Zhu, Zhu, Junyou, Yanyuan Qiao +9 · 3 citations
Computer Science · Engineering · #Advanced Image and Video Retrieval Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Robotics and Sensor-Based Localization
- SC-Tune: Unleashing Self-Consistent Referential Comprehension in Large Vision Language Models
2024/03/20 by Tongtian Yue, Jie Cheng, Yue, Tongtian +15 · 2 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Enhancing Vision-Language Pre-Training with Jointly Learned Questioner and Dense Captioner
2023/05/19 by Zikang Liu, Sihan Chen, Liu, Zikang +9 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimedia (cs.MM) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- CM-MaskSD: Cross-Modality Masked Self-Distillation for Referring Image Segmentation
2023/05/19 by Wenxuan Wang, Jing Liu, Wang, Wenxuan +13 · 1 citation
Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Topic Modeling
- MMNet: Multi-Mask Network for Referring Image Segmentation
2023/05/24 by Yichen Yan, Yan, Yichen, Xingjian He +5 · 1 citation
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Fuse & Calibrate: A bi-directional Vision-Language Guided Framework for Referring Image Segmentation
2024/05/18 by Yichen Yan, Yan, Yichen, Xingjian He +7 · 1 citation
Computer Science · #Advanced Image and Video Retrieval Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Image Retrieval and Classification Techniques #Multimodal Machine Learning Applications