Weidi Xie
- PMC-LLaMA: Towards Building Open-source Language Models for Medicine
2023/04/27 by Chaoyi Wu, Wu, Chaoyi, Weixiong Lin +9 · 2 voices · 13 citations
Computer Science · Medicine · #Artificial Intelligence in Healthcare and Education #Natural Language Processing Techniques #Topic Modeling #cs.CL
- VGGSound: A Large-scale Audio-Visual Dataset
2020/04/29 by Honglie Chen, Chen, Honglie, Weidi Xie +5 · 102 citations
Computer Science · #Music and Audio Processing #Speech and Audio Processing #Speech Recognition and Synthesis
- VGGFace2: A dataset for recognising faces across pose and age
2017/10/23 by Qiong Cao, Cao, Qiong, Li Shen +7 · 63 citations
Computer Science · #Biometric Identification and Security #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Face and Expression Recognition #Face recognition and analysis
- Voxceleb: Large-scale speaker verification in the wild
2019/10/16 by Arsha Nagrani, Joon Son Chung, Weidi Xie +1 · 42 citations
Computer Science · #Music and Audio Processing #Speech Recognition and Synthesis #Speech and Audio Processing
- PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answering
2023/05/17 by Xiaoman Zhang, Chaoyi Wu, Zhang, Xiaoman +11 · 50 citations
Computer Science · #Multimodal Machine Learning Applications #Advanced Image and Video Retrieval Techniques #Domain Adaptation and Few-Shot Learning
- A Sanity Check for AI-generated Image Detection
2024/06/27 by Shilin Yan, Ouxiang Li, Yan, Shilin +11 · 45 citations
Computer Science · Medicine · #Adversarial Robustness in Machine Learning #Artificial Intelligence in Healthcare and Education #Explainable Artificial Intelligence (XAI)
- Synchformer: Efficient Synchronization from Sparse Cues
2024/01/29 by Vladimir Iashin, Weidi Xie, Iashin, Vladimir +5 · 31 citations
Computer Science · Engineering · #Audio and Speech Processing (eess.AS) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Multimedia (cs.MM) #Neural Networks and Applications #Neural Networks and Reservoir Computing #Photonic and Optical Devices #Sound (cs.SD) #electronic engineering #information engineering
- Knowledge-enhanced Visual-Language Pre-training on Chest Radiology Images
2023/02/27 by Xiaoman Zhang, Zhang, Xiaoman, Chaoyi Wu +7 · 24 citations
Computer Science · Medicine · #COVID-19 diagnosis using AI #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- VISA: Reasoning Video Object Segmentation via Large Language Models
2024/07/16 by Cilin Yan, Haochen Wang, Yan, Cilin +13 · 35 citations
Computer Science · #Multimodal Machine Learning Applications #Advanced Neural Network Applications #Advanced Image and Video Retrieval Techniques
- Prompting Visual-Language Models for Efficient Video Understanding
2021/12/08 by Chen Ju, Tengda Han, Ju, Chen +7 · 16 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications
- ReCo: Retrieve and Co-segment for Zero-shot Transfer
2022/06/14 by Gyungin Shin, Weidi Xie, Shin, Gyungin +3 · 15 citations
Computer Science · Medicine · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #COVID-19 diagnosis using AI
- Self-supervised Co-training for Video Representation Learning
2020/10/19 by Tengda Han, Weidi Xie, Han, Tengda +3 · 20 citations
Computer Science · #Human Pose and Action Recognition #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning
- Collaboration Helps Camera Overtake LiDAR in 3D Detection
2023/03/23 by Yue Hu, Hu, Yue, Yifan Lu +9 · 15 citations
Computer Science · Engineering · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Robotics and Sensor-Based Localization #Video Surveillance and Tracking Methods
- WorldSense: Evaluating Real-world Omnimodal Understanding for Multimodal LLMs
2025/02/06 by Shilin Yan, Hong, Jack, Jiayin Cai +8 · 32 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Natural Language Processing Techniques #Semantic Web and Ontologies #Speech and dialogue systems
- PromptDet: Towards Open-vocabulary Detection using Uncurated Images
2022/03/30 by Chengjian Feng, Feng, Chengjian, Yujie Zhong +13 · 12 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Advanced Image and Video Retrieval Techniques
- Towards Building Multilingual Language Model for Medicine
2024/02/21 by Pengcheng Qiu, Qiu, Pengcheng, Chaoyi Wu +13 · 16 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Biomedical Text Mining and Ontologies #Topic Modeling
- Self-supervised Video Object Segmentation by Motion Grouping
2021/04/15 by Charig Yang, Hala Lamdouar, Yang, Charig +7 · 9 citations
Computer Science · #Advanced Vision and Imaging #Video Surveillance and Tracking Methods #Advanced Image and Video Retrieval Techniques
- Learning Open-vocabulary Semantic Segmentation Models From Natural Language Supervision
2023/01/22 by Jilan Xu, Junlin Hou, Xu, Jilan +11 · 11 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Topic Modeling
- Open-vocabulary Object Segmentation with Diffusion Models
2023/01/12 by Ziyi Li, Qinye Zhou, Li, Ziyi +9 · 11 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Towards Generalist Foundation Model for Radiology by Leveraging Web-scale 2D&3D Medical Data
2023/08/04 by Chaoyi Wu, Wu, Chaoyi, Xiaoman Zhang +7 · 11 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Segmenting Moving Objects via an Object-Centric Layered Representation
2022/07/05 by Junyu Xie, Xie, Junyu, Weidi Xie +3 · 8 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Video Surveillance and Tracking Methods
- Utterance-level Aggregation For Speaker Recognition In The Wild
2019/02/26 by Weidi Xie, Arsha Nagrani, Xie, Weidi +5 · 8 citations
Computer Science · #Speech Recognition and Synthesis #Music and Audio Processing #Speech and Audio Processing
- Sparse in Space and Time: Audio-visual Synchronisation with Trainable Selectors
2022/10/13 by Vladimir Iashin, Weidi Xie, Iashin, Vladimir +5 · 8 citations
Computer Science · #Speech and Audio Processing #Music and Audio Processing #Video Analysis and Summarization
- NeRF--: Neural Radiance Fields Without Known Camera Parameters
2021/02/14 by Zirui Wang, Wang, Zirui, Shangzhe Wu +7 · 9 citations
Computer Science · Engineering · #Advanced Vision and Imaging #Robotics and Sensor-Based Localization #Computer Graphics and Visualization Techniques
- RaTEScore: A Metric for Radiology Report Generation
2024/06/24 by Weike Zhao, Chaoyi Wu, Zhao, Weike +9 · 11 citations
Biochemistry, Genetics and Molecular Biology · Medicine · #Biomedical Text Mining and Ontologies #Computation and Language (cs.CL) #FOS: Computer and information sciences #Radiomics and Machine Learning in Medical Imaging
- Annotation-free Audio-Visual Segmentation
2023/05/18 by Jinxiang Liu, Liu, Jinxiang, Yu Wang +9 · 8 citations
Computer Science · #Music and Audio Processing #Speech and Audio Processing #Digital Media Forensic Detection
- Temporal Alignment Networks for Long-term Video
2022/04/06 by Tengda Han, Han, Tengda, Weidi Xie +3 · 6 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications #Video Analysis and Summarization
- Can GPT-4V(ision) Serve Medical Applications? Case Studies on GPT-4V for Multimodal Medical Diagnosis
2023/10/15 by Chaoyi Wu, Jiayu Lei, Wu, Chaoyi +19 · 7 citations
Medicine · #Artificial Intelligence in Healthcare and Education #COVID-19 diagnosis using AI #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Radiomics and Machine Learning in Medical Imaging
- Grounded Multi-Hop VideoQA in Long-Form Egocentric Videos
2024/08/26 by Qirui Chen, Shangzhe Di, Chen, Qirui +3 · 9 citations
Social Sciences · #Multimedia Communication and Technology
- Audio-Visual Synchronisation in the wild
2021/12/08 by Honglie Chen, Weidi Xie, Chen, Honglie +9 · 4 citations
Computer Science · #Audio and Speech Processing (eess.AS) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Speech and Audio Processing #Video Analysis and Summarization #electronic engineering #information engineering
- MatchTime: Towards Automatic Soccer Game Commentary Generation
2024/06/26 by Jiayuan Rao, Haoning Wu, Rao, Jiayuan +7 · 8 citations
Computer Science · Economics, Econometrics and Finance · #Artificial Intelligence in Games #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Sports Analytics and Performance #Video Analysis and Summarization
- Multi-Modal Classifiers for Open-Vocabulary Object Detection
2023/06/08 by Prannay Kaul, Kaul, Prannay, Weidi Xie +3 · 5 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #I.2.10 #I.4.6 #I.4.8 #I.4.9 #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Topic Modeling
- Towards Evaluating and Building Versatile Large Language Models for Medicine
2024/08/22 by Chaoyi Wu, Pengcheng Qiu, Wu, Chaoyi +13 · 9 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Biomedical Text Mining and Ontologies #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning in Healthcare #Topic Modeling
- OvarNet: Towards Open-vocabulary Object Attribute Recognition
2023/01/23 by Keyan Chen, Chen, Keyan, Xiaolong Jiang +11 · 4 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Advanced Image and Video Retrieval Techniques
- InstaGen: Enhancing Object Detection by Training on Synthetic Dataset
2024/02/08 by Chengjian Feng, Yujie Zhong, Feng, Chengjian +7 · 5 citations
Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- ChestX-Reasoner: Advancing Radiology Foundation Models with Reasoning through Step-by-Step Verification
2025/04/29 by Cheng Liang, Fan, Ziqing, Liang, Cheng +8 · 12 citations
Medicine · Computer Science · #Artificial Intelligence in Healthcare and Education #Topic Modeling #Multimodal Machine Learning Applications
- All you need are a few pixels: semantic segmentation with PixelPick
2021/04/13 by Gyungin Shin, Shin, Gyungin, Weidi Xie +3 · 4 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning and Algorithms #Multimodal Machine Learning Applications
- Knowledge-enhanced Pretraining for Vision-language Pathology Foundation Model on Cancer Diagnosis
2024/12/17 by Xiao Zhou, Zhou, Xiao, Luoyi Sun +21 · 8 citations
Computer Science · Biochemistry, Genetics and Molecular Biology · #AI in cancer detection #Biomedical Text Mining and Ontologies
- Track-On: Transformer-based Online Point Tracking with Memory
2025/01/30 by Görkay Aydemir, Aydemir, Görkay, X. Cai +5 · 7 citations
Computer Science · Engineering · #Advanced Vision and Imaging #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Inertial Sensor and Navigation #Iterative Learning Control Systems
- Multi-modal Prompting for Low-Shot Temporal Action Localization
2023/03/21 by Chen Ju, Ju, Chen, Zeqian Li +13 · 3 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications #Video Analysis and Summarization
- Towards Universal Soccer Video Understanding
2024/12/02 by Joe Rao, Rao, Jiayuan, Haoning Wu +9 · 6 citations
Computer Science · Engineering · Social Sciences · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Motion and Animation #Multimedia Communication and Technology #Video Analysis and Summarization
- AutoAD III: The Prequel -- Back to the Pixels
2024/04/22 by Tengda Han, Max Bain, Han, Tengda +9 · 5 citations
Engineering · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Optical Network Technologies
- Knowledge-enhanced Visual-Language Pretraining for Computational Pathology
2024/04/15 by Xiao Zhou, Zhou, Xiao, Xiaoman Zhang +9 · 3 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Cancer-related molecular mechanisms research #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- How Well Can Modern LLMs Act as Agent Cores in Radiology Environments?
2024/12/12 by Qiaoyu Zheng, Chaoyi Wu, Zheng, Qiaoyu +11 · 4 citations
Engineering · Medicine · #Advanced X-ray and CT Imaging #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Radiology practices and education
- Multi-Sentence Grounding for Long-term Instructional Video
2023/12/21 by Zeqian Li, Li, Zeqian, Qirui Chen +9 · 2 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Video Analysis and Summarization
- Self-supervised Learning for Video Correspondence Flow
2019/05/02 by Zihang Lai, Weidi Xie, Lai, Zihang +1 · 1 citation
Computer Science · #Advanced Vision and Imaging #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Machine Learning (cs.LG) #Video Surveillance and Tracking Methods
- AutoAD-Zero: A Training-Free Framework for Zero-Shot Audio Description
2024/07/22 by Junyu Xie, Xie, Junyu, Tengda Han +11 · 4 citations
Arts and Humanities · Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Music and Audio Processing #Natural Language Processing Techniques #Subtitles and Audiovisual Media
- Multi-Agent System for Comprehensive Soccer Understanding
2025/05/06 by Joe Rao, Rao, Jiayuan, Zifeng Li +9 · 5 citations
Economics, Econometrics and Finance · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Sports Analytics and Performance
- Inducing Predictive Uncertainty Estimation for Face Recognition
2020/09/01 by Weidi Xie, Jeffrey Byrne, Xie, Weidi +3 · 1 citation
Computer Science · #Adversarial Robustness in Machine Learning #Anomaly Detection Techniques and Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Face recognition and analysis #Machine Learning (cs.LG)
- Quantum Self-Supervised Learning
2021/03/26 by Ben Jaderberg, Lewis W. Anderson, Jaderberg, Ben +9 · 1 citation
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Physical sciences #Machine Learning (cs.LG) #Neural Networks and Reservoir Computing #Quantum Computing Algorithms and Architecture #Quantum Information and Cryptography #Quantum Physics (quant-ph)
- Transforming the Interactive Segmentation for Medical Imaging
2022/08/20 by Wentao Liu, Liu, Wentao, Chaofan Ma +7 · 2 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- Turbo Training with Token Dropout
2022/10/10 by Tengda Han, Han, Tengda, Weidi Xie +3 · 1 citation
Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition
- MRGen: Segmentation Data Engine for Underrepresented MRI Modalities
2024/12/04 by Haoning Wu, Wu, Haoning, Ziheng Zhao +7 · 1 citation
Computer Science · Medicine · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Medical Image Segmentation Techniques #Radiomics and Machine Learning in Medical Imaging
- BasketEvent: Understanding Who Did What and When in Basketball Videos
2026/07/23 by Yu Zhang, Jiayuan Rao, Haoning Wu +1
#cs.AI