Serena Yeung-Levy
- VideoAgent: Long-form Video Understanding with Large Language Model as Agent
2024/03/15 by Xiaohan Wang, Yuhui Zhang, Wang, Xiaohan +5 · 125 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Multimodal Machine Learning Applications
- Apollo: An Exploration of Video Understanding in Large Multimodal Models
2024/12/13 by Orr Zohar, Zohar, Orr, Xiaohan Wang +21 · 3 voices · 38 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Semantic Web and Ontologies
- How to Build the Virtual Cell with Artificial Intelligence: Priorities and Opportunities
2024/09/18 by Charlotte Bunne, Yusuf Roohani, Bunne, Charlotte +81 · 4 voices · 31 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Artificial Intelligence (cs.AI) #FOS: Biological sciences #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neurons and Cognition (q-bio.NC) #Quantitative Methods (q-bio.QM) #cs.AI #cs.LG #q-bio.NC #q-bio.QM
- Describing Differences in Image Sets with Natural Language
2023/12/05 by Lisa Dunlap, Dunlap, Lisa, Yuhui Zhang +13 · 10 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Computers and Society (cs.CY) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Connect, Collapse, Corrupt: Learning Cross-Modal Tasks with Uni-Modal Data
2024/01/16 by Yuhui Zhang, Elaine Sui, Zhang, Yuhui +3 · 8 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Video Analysis and Summarization
- BIOMEDICA: An Open Biomedical Image-Caption Archive, Dataset, and Vision-Language Models Derived from Scientific Literature
2025/01/13 by Alejandro Lozano, Lozano, Alejandro, Min Sun +27 · 15 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #AI in cancer detection #Biomedical Text Mining and Ontologies #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Digital Imaging for Blood Diseases #FOS: Computer and information sciences
- Temporal Preference Optimization for Long-Form Video Understanding
2025/01/23 by Rui Li, Li, Rui, Xiaohan Wang +8 · 14 citations
Computer Science · #Advanced Vision and Imaging #Human Pose and Action Recognition #Advanced Data Compression Techniques
- Automated Generation of Challenging Multiple-Choice Questions for Vision Language Model Evaluation
2025/01/06 by Yuhui Zhang, Zhang, Yuhui, Yuchang Su +21 · 1 voice · 13 citations
Computer Science · Social Sciences · #Geographic Information Systems Studies #Multimodal Machine Learning Applications #cs.AI #cs.CL #cs.CV #cs.CY #cs.LG
- Template-Free Single-View 3D Human Digitalization with Diffusion-Guided LRM
2024/01/22 by Zhenzhen Weng, Jingyuan Liu, Weng, Zhenzhen +11 · 7 citations
Engineering · Computer Science · #3D Shape Modeling and Analysis #Human Pose and Action Recognition #Advanced Vision and Imaging
- MicroVQA: A Multimodal Reasoning Benchmark for Microscopy-Based Scientific Research
2025/03/17 by James Burgess, Jeffrey J Nirschl, Burgess, James +43 · 1 voice · 13 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Artificial Intelligence (cs.AI) #Cell Behavior (q-bio.CB) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Biological sciences #FOS: Computer and information sciences #Machine Learning (cs.LG) #cs.AI #cs.CL #cs.CV #cs.LG #q-bio.CB
- CellFlux: Simulating Cellular Morphology Changes via Flow Matching
2025/02/13 by Yuhui Zhang, Zhang, Yuhui, Yuchang Su +19 · 10 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Biomolecules (q-bio.BM) #Cell Behavior (q-bio.CB) #Cell Image Analysis Techniques #Computer Graphics and Visualization Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Biological sciences #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Quantitative Methods (q-bio.QM)
- Video Action Differencing
2025/03/10 by James Burgess, Xiaohan Wang, Burgess, James +14 · 1 voice · 7 citations
Computer Science · #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Machine Learning (cs.LG) #Video Coding and Compression Technologies #cs.AI #cs.CV #cs.LG
- μ-Bench: A Vision-Language Benchmark for Microscopy Understanding
2024/07/01 by Alejandro Lozano, Jeffrey Nirschl, Lozano, Alejandro +11 · 5 citations
Biochemistry, Genetics and Molecular Biology · Materials Science · #Artificial Intelligence (cs.AI) #Cell Image Analysis Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning in Materials Science
- Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision
2024/07/08 by Orr Zohar, Zohar, Orr, Xiaohan Wang +7 · 4 citations
Social Sciences · #Artificial Intelligence (cs.AI) #Collaborative Teaching and Inclusion #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- How to build the virtual cell with artificial intelligence: Priorities and opportunities
2024/12/01 by Charlotte Bunne, Yusuf Roohani, Yanay Rosen +39 · 1 voice · 4 citations
Biochemistry, Genetics and Molecular Biology · #Single-cell and spatial transcriptomics #Cell Image Analysis Techniques
- NegVQA: Can Vision Language Models Understand Negation?
2025/05/28 by Yuhui Zhang, Zhang, Yuhui, Yuchang Su +5 · 3 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Computers and Society (cs.CY) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Topic Modeling
- Foundation Models Secretly Understand Neural Network Weights: Enhancing Hypernetwork Architectures with Foundation Models
2025/03/02 by Jeffrey Gu, Serena Yeung-Levy, Gu, Jeffrey +1 · 1 voice · 3 citations
Computer Science · #Adversarial Robustness in Machine Learning #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #cs.CV #cs.LG