Lin, Xudong
- BLINK: Multimodal Large Language Models Can See but Not Perceive
2024/04/18 by Xingyu Fu, Yushi Hu, Fu, Xingyu +18 · 1 voice · 143 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling
- Exploring the Reasoning Abilities of Multimodal Large Language Models (MLLMs): A Comprehensive Survey on Emerging Trends in Multimodal Reasoning
2024/01/10 by Yiqi Wang, Wentao Chen, Wang, Yiqi +17 · 33 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Text Readability and Simplification
- All in One: Exploring Unified Video-Language Pre-training
2022/03/14 by Alex Jinpeng Wang, Wang, Alex Jinpeng, Yixiao Ge +17 · 9 citations
Computer Science · #Multimodal Machine Learning Applications #Human Pose and Action Recognition #Topic Modeling
- Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners
2022/05/22 by Wang, Zhenhailong, Li, Manling, Xu, Ruochen +10 · 6 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Learning To Recognize Procedural Activities with Distant Supervision
2022/01/26 by Xudong Lin, Fabio Petroni, Lin, Xudong +9 · 3 citations
Computer Science · #Human Pose and Action Recognition #Video Analysis and Summarization #Music and Audio Processing
- Towards Fast Adaptation of Pretrained Contrastive Models for Multi-channel Video-Language Retrieval
2022/06/05 by Xudong Lin, Simran Tiwari, Lin, Xudong +11 · 3 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- SCHEMA: State CHangEs MAtter for Procedure Planning in Instructional Videos
2024/03/03 by Niu, Yulei, Guo, Wenliang, Chen, Long +2 · 5 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Co-Grounding Networks with Semantic Attention for Referring Expression Comprehension in Videos
2021/03/23 by Song, Sijie, Lin, Xudong, Liu, Jiaying +2 · 2 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Joint Multimedia Event Extraction from Video and Article
2021/09/27 by Brian Chen, Chen, Brian, Xudong Lin +13 · 2 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimedia (cs.MM) #Multimodal Machine Learning Applications #Music and Audio Processing #Video Analysis and Summarization
- Can Long-Context Language Models Subsume Retrieval, RAG, SQL, and More?
2024/06/19 by Jinhyuk Lee, Lee, Jinhyuk, Anthony Chen +35 · 3 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Natural Language Processing Techniques #Topic Modeling
- Learning to Decompose Visual Features with Latent Textual Prompts
2022/10/09 by Feng Wang, Manling Li, Wang, Feng +9 · 2 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques
- Supervised Masked Knowledge Distillation for Few-Shot Transformers
2023/03/25 by Han Lin, Guangxing Han, Lin, Han +9 · 2 citations
Computer Science · Medicine · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #COVID-19 diagnosis using AI #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences
- TempCLR: Temporal Alignment Representation with Contrastive Learning
2022/12/28 by Yuncong Yang, Jiawei Ma, Yang, Yuncong +11 · 2 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications #Video Analysis and Summarization
- Context-Gated Convolution
2019/10/12 by Lin, Xudong, Ma, Lin, Liu, Wei +1 · 1 citation
#Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Video-Text Pre-training with Learned Regions
2021/12/02 by Yan, Rui, Shou, Mike Zheng, Ge, Yixiao +4 · 1 citation
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimedia (cs.MM)
- MuMuQA: Multimedia Multi-Hop News Question Answering via Cross-Media Knowledge Extraction and Grounding
2021/12/20 by Reddy, Revanth Gangi, Rui, Xilin, Li, Manling +9 · 1 citation
#Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Beyond Grounding: Extracting Fine-Grained Event Hierarchies Across Modalities
2022/06/14 by Hammad A. Ayyubi, Ayyubi, Hammad A., Christopher E. Thomas +18 · 1 citation
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- Video Event Extraction via Tracking Visual States of Arguments
2022/11/03 by Guang Yang, Manling Li, Yang, Guang +9 · 1 citation
Computer Science · #Anomaly Detection Techniques and Applications #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications
- Weakly-Supervised Temporal Article Grounding
2022/10/22 by Long Chen, Yulei Niu, Chen, Long +15 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimedia (cs.MM) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Language Models are Causal Knowledge Extractors for Zero-shot Video Question Answering
2023/04/07 by Su, Hung-Ting, Niu, Yulei, Lin, Xudong +2 · 1 citation
#Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Non-Sequential Graph Script Induction via Multimedia Grounding
2023/05/27 by Yu Zhou, Sha Li, Zhou, Yu +11 · 1 citation
Computer Science · #Advanced Graph Neural Networks #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimedia (cs.MM) #Multimodal Machine Learning Applications #Topic Modeling
- Unveiling Narrative Reasoning Limits of Large Language Models with Trope in Movie Synopses
2024/09/22 by Hung-Ting Su, Su, Hung-Ting, Ya-Ching Hsu +11 · 1 citation
Computer Science · Social Sciences · #Topic Modeling #Natural Language Processing Techniques #Computational and Text Analysis Methods
- Progress of the TianQin project
2025/02/17 by Jun Luo, Shaojun Bai, Luo, Jun +233 · 1 citation
Engineering · #Space Technology and Applications #Robotics and Automated Systems