Gan, Zhe
- MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training
2024/03/14 by Brandon McKinzie, McKinzie, Brandon, Zhe Gan +61 · 9 voices · 13 citations
#cs.CV #cs.CL #cs.LG
- GIT: A Generative Image-to-text Transformer for Vision and Language
2022/05/27 by Jianfeng Wang, Zhengyuan Yang, Wang, Jianfeng +15 · 2 voices · 47 citations
Computer Science · #Handwritten Text Recognition Techniques #Multimodal Machine Learning Applications #Natural Language Processing Techniques #cs.CV
- Pico-Banana-400K: A Large-Scale Dataset for Text-Guided Image Editing
2025/10/22 by Yusu Qian, Eli Bocek-Rivele, Qian, Yusu +13 · 5 voices · 8 citations
#cs.CV #cs.CL #cs.LG
- AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networks
2017/11/28 by Tao Xu, Xu, Tao, Pengchuan Zhang +11 · 1 voice · 24 citations
Computer Science · #Generative Adversarial Networks and Image Synthesis #Human Pose and Action Recognition #Multimodal Machine Learning Applications #cs.CV
- Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMs
2024/04/08 by Keen You, Haotian Zhang, You, Keen +13 · 4 voices · 26 citations
Computer Science · #Speech and dialogue systems #cs.CL #cs.CV #cs.HC
- Ferret: Refer and Ground Anything Anywhere at Any Granularity
2023/10/11 by You, Haoxuan, Zhang, Haotian, Gan, Zhe +6 · 67 citations
#Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Patient Knowledge Distillation for BERT Model Compression
2019/08/25 by Sun, Siqi, Cheng, Yu, Gan, Zhe +1 · 28 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- CLUB: A Contrastive Log-ratio Upper Bound of Mutual Information
2020/06/22 by Cheng, Pengyu, Hao, Weituo, Dai, Shuyang +3 · 24 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Generalized Decoding for Pixel, Image, and Language
2022/12/21 by Xueyan Zou, Zou, Xueyan, Zi-Yi Dou +25 · 32 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Less is More: ClipBERT for Video-and-Language Learning via Sparse Sampling
2021/02/11 by Jie Lei, Linjie Li, Lei, Jie +11 · 25 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications
- Variational Autoencoder for Deep Learning of Images, Labels and Captions
2016/09/28 by Yunchen Pu, Zhe Gan, Pu, Yunchen +11 · 20 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications
- MM1.5: Methods, Analysis & Insights from Multimodal LLM Fine-tuning
2024/09/30 by Haotian Zhang, Zhang, Haotian, Mingfei Gao +43 · 1 voice · 13 citations
Computer Science · #cs.CV #cs.CL #cs.LG
- Multimodal Foundation Models: From Specialists to General-Purpose Assistants
2023/09/18 by Chunyuan Li, Li, Chunyuan, Zhe Gan +11 · 28 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- StoryGAN: A Sequential Conditional GAN for Story Visualization
2018/12/06 by Yitong Li, Li, Yitong, Zhe Gan +15 · 13 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications #Video Analysis and Summarization
- ReCo: Region-Controlled Text-to-Image Generation
2022/11/23 by Zhengyuan Yang, Jianfeng Wang, Yang, Zhengyuan +19 · 19 citations
Computer Science · #Multimodal Machine Learning Applications #Image Retrieval and Classification Techniques #Generative Adversarial Networks and Image Synthesis
- Adversarial GLUE: A Multi-Task Benchmark for Robustness Evaluation of Language Models
2021/11/04 by Wang, Boxin, Xu, Chejian, Wang, Shuohang +5 · 16 citations
#Computation and Language (cs.CL) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training
2020/05/01 by Linjie Li, Yen-Chun Chen, Li, Linjie +9 · 14 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Human Pose and Action Recognition #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- An Empirical Study of GPT-3 for Few-Shot Knowledge-Based VQA
2021/09/10 by Zhengyuan Yang, Yang, Zhengyuan, Zhe Gan +11 · 15 citations
Computer Science · #Multimodal Machine Learning Applications #Advanced Image and Video Retrieval Techniques #Domain Adaptation and Few-Shot Learning
- Guiding Instruction-based Image Editing via Multimodal Large Language Models
2023/09/29 by Tsu-Jui Fu, Fu, Tsu-Jui, Wenze Hu +9 · 21 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Advanced Image and Video Retrieval Techniques
- Prompting GPT-3 To Be Reliable
2022/10/17 by Si, Chenglei, Gan, Zhe, Yang, Zhengyuan +4 · 15 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Improve Vision Language Model Chain-of-thought Reasoning
2024/10/21 by Ruohong Zhang, Bowen Zhang, Zhang, Ruohong +15 · 30 citations
Computer Science · #Semantic Web and Ontologies
- FreeLB: Enhanced Adversarial Training for Natural Language Understanding
2019/09/25 by Zhu, Chen, Cheng, Yu, Gan, Zhe +3 · 10 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- VeCLIP: Improving CLIP Training via Visual-enriched Captions
2023/10/11 by Zhengfeng Lai, Lai, Zhengfeng, Haotian Zhang +20 · 18 citations
Computer Science · #Multimodal Machine Learning Applications #Advanced Image and Video Retrieval Techniques #Domain Adaptation and Few-Shot Learning
- Scaling Up Vision-Language Pre-training for Image Captioning
2021/11/24 by Xiaowei Hu, Hu, Xiaowei, Zhe Gan +11 · 12 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- Multimodal Autoregressive Pre-training of Large Vision Encoders
2024/11/21 by Enrico Fini, Mustafa Shukor, Fini, Enrico +29 · 27 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural Networks and Applications
- Ferret-v2: An Improved Baseline for Referring and Grounding with Large Language Models
2024/04/11 by Haotian Zhang, Zhang, Haotian, Haoxuan You +19 · 20 citations
Computer Science · Medicine · #Multimodal Machine Learning Applications #COVID-19 diagnosis using AI #Domain Adaptation and Few-Shot Learning
- SwinBERT: End-to-End Transformers with Sparse Attention for Video Captioning
2021/11/25 by Lin, Kevin, Li, Linjie, Lin, Chung-Ching +5 · 11 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- An Empirical Study of Training End-to-End Vision-and-Language Transformers
2021/11/03 by Zi-Yi Dou, Dou, Zi-Yi, Yichong Xu +21 · 12 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Advanced Neural Network Applications
- SlowFast-LLaVA: A Strong Training-Free Baseline for Video Large Language Models
2024/07/22 by Mingze Xu, Mingfei Gao, Xu, Mingze +13 · 20 citations
Computer Science · Medicine · #COVID-19 diagnosis using AI #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications
- Generating Informative and Diverse Conversational Responses via\n Adversarial Information Maximization
2018/09/16 by Yizhe Zhang, Michel Galley, Zhang, Yizhe +11 · 11 citations
Computer Science · Physics and Astronomy · #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Model Reduction and Neural Networks #Topic Modeling
- Adversarial VQA: A New Benchmark for Evaluating the Robustness of VQA Models
2021/06/01 by Linjie Li, Li, Linjie, Jie Lei +5 · 8 citations
Computer Science · Medicine · #COVID-19 diagnosis using AI #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- Adversarial Feature Matching for Text Generation
2017/06/12 by Zhang, Yizhe, Gan, Zhe, Fan, Kai +4 · 6 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Relation-Aware Graph Attention Network for Visual Question Answering
2019/03/29 by Linjie Li, Li, Linjie, Zhe Gan +5 · 7 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- MIA-Bench: Towards Better Instruction Following Evaluation of Multimodal LLMs
2024/07/01 by Yusu Qian, Hanrong Ye, Qian, Yusu +9 · 15 citations
Arts and Humanities · Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Natural Language Processing Techniques #Translation Studies and Practices #linguistics and terminology studies
- Compressing LLMs: The Truth is Rarely Pure and Never Simple
2023/10/02 by Jaiswal, Ajay, Gan, Zhe, Du, Xianzhi +3 · 1 voice · 8 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- NUWA-Infinity: Autoregressive over Autoregressive Generation for Infinite Visual Synthesis
2022/07/20 by Chenfei Wu, Wu, Chenfei, Jian Liang +15 · 8 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Advanced Vision and Imaging #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis
- Large-Scale Adversarial Training for Vision-and-Language Representation Learning
2020/06/11 by Gan, Zhe, Chen, Yen-Chun, Li, Linjie +3 · 6 citations
#Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- UniTAB: Unifying Text and Box Outputs for Grounded Vision-Language Modeling
2021/11/23 by Yang, Zhengyuan, Gan, Zhe, Wang, Jianfeng +5 · 7 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- GRiT: A Generative Region-to-text Transformer for Object Understanding
2022/12/01 by Jialian Wu, Wu, Jialian, Jianfeng Wang +11 · 8 citations
Computer Science · #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- TIGEr: Text-to-Image Grounding for Image Caption Evaluation
2019/09/04 by Jiang, Ming, Huang, Qiuyuan, Zhang, Lei +5 · 5 citations
#Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- UNITER: UNiversal Image-TExt Representation Learning
2019/09/25 by Chen, Yen-Chun, Li, Linjie, Yu, Licheng +5 · 5 citations
#Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Hierarchical Graph Network for Multi-hop Question Answering
2019/11/09 by Fang, Yuwei, Sun, Siqi, Gan, Zhe +3 · 5 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- VIOLET : End-to-End Video-Language Transformers with Masked Visual-token Modeling
2021/11/24 by Fu, Tsu-Jui, Li, Linjie, Gan, Zhe +4 · 6 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- From Multimodal LLMs to Generalist Embodied Agents: Methods and Lessons
2024/12/11 by Szot, Andrew, Mazoure, Bogdan, Attia, Omar +6 · 14 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG)
- Contrastive Distillation on Intermediate Representations for Language Model Compression
2020/09/29 by Siqi Sun, Zhe Gan, Sun, Siqi +9 · 6 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- InfoBERT: Improving Robustness of Language Models from An Information\n Theoretic Perspective
2020/10/05 by Boxin Wang, Wang, Boxin, Shuohang Wang +11 · 5 citations
Computer Science · #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- K-LITE: Learning Transferable Visual Models with External Knowledge
2022/04/20 by Shen, Sheng, Li, Chunyuan, Hu, Xiaowei +11 · 6 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- VALUE: A Multi-Task Benchmark for Video-and-Language Understanding Evaluation
2021/06/08 by Linjie Li, Li, Linjie, Jie Lei +27 · 6 citations
Computer Science · #Multimodal Machine Learning Applications #Topic Modeling #Domain Adaptation and Few-Shot Learning
- Chasing Sparsity in Vision Transformers: An End-to-End Exploration
2021/06/08 by Tianlong Chen, Yu Cheng, Chen, Tianlong +9 · 5 citations
Computer Science · Engineering · #Advanced Memory and Neural Computing #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Visual Attention and Saliency Detection
- Tactical Rewind: Self-Correction via Backtracking in Vision-and-Language Navigation
2019/03/06 by Liyiming Ke, Xiujun Li, Ke, Liyiming +15 · 4 citations
Computer Science · #Multimodal Machine Learning Applications #Advanced Image and Video Retrieval Techniques #Domain Adaptation and Few-Shot Learning
- How Easy is It to Fool Your Multimodal LLMs? An Empirical Analysis on Deceptive Prompts
2024/02/20 by Yusu Qian, Qian, Yusu, Haotian Zhang +5 · 8 citations
Social Sciences · #Artificial Intelligence in Law #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Behind the Scene: Revealing the Secrets of Pre-trained Vision-and-Language Models
2020/05/15 by Cao, Jize, Gan, Zhe, Cheng, Yu +3 · 4 citations
#Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- An Empirical Study of Multimodal Model Merging
2023/04/28 by Yi-Lin Sung, Sung, Yi-Lin, Linjie Li +9 · 6 citations
Computer Science · #Multimodal Machine Learning Applications #Topic Modeling #Domain Adaptation and Few-Shot Learning
- Wasserstein Contrastive Representation Distillation
2020/12/15 by Chen, Liqun, Wang, Dong, Gan, Zhe +3 · 4 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Ferret-UI 2: Mastering Universal User Interface Understanding Across Platforms
2024/10/24 by Zhangheng Li, Li, Zhangheng, Keen You +17 · 11 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Usability and User Interface Design
- Contrastive Localized Language-Image Pre-Training
2024/10/03 by Hong-You Chen, Chen, Hong-You, Zhengfeng Lai +17 · 1 voice · 7 citations
Arts and Humanities · Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #EFL/ESL Teaching and Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Second Language Learning and Teaching #cs.CV #cs.LG
- Sequential Attention GAN for Interactive Image Editing
2018/12/20 by Yu Cheng, Cheng, Yu, Zhe Gan +7 · 3 citations
Computer Science · #Multimodal Machine Learning Applications #Generative Adversarial Networks and Image Synthesis #Video Analysis and Summarization
- LAVENDER: Unifying Video-Language Understanding as Masked Language Modeling
2022/06/14 by Li, Linjie, Gan, Zhe, Lin, Kevin +4 · 4 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Discourse-Aware Neural Extractive Text Summarization
2019/10/30 by Xu, Jiacheng, Gan, Zhe, Cheng, Yu +1 · 3 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- An Empirical Study of End-to-End Video-Language Transformers with Masked Visual Modeling
2022/09/04 by Tsu-Jui Fu, Linjie Li, Fu, Tsu-Jui +11 · 4 citations
Computer Science · #Multimodal Machine Learning Applications #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning
- Vision-Language Pre-training: Basics, Recent Advances, and Future Trends
2022/10/17 by Gan, Zhe, Li, Linjie, Li, Chunyuan +3 · 4 citations
#Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Non-Contrastive Learning Meets Language-Image Pre-Training
2022/10/17 by Zhou, Jinghao, Dong, Li, Gan, Zhe +2 · 4 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Multi-Fact Correction in Abstractive Text Summarization
2020/10/06 by Dong, Yue, Wang, Shuohang, Gan, Zhe +3 · 3 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- MM-Ego: Towards Building Egocentric Multimodal LLMs for Video QA
2024/10/09 by Haihong Ye, Haotian Zhang, Ye, Hanrong +19 · 7 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Semantic Web and Ontologies #Speech and dialogue systems
- What Makes A Good Story? Designing Composite Rewards for Visual Storytelling
2019/09/11 by Junjie Hu, Yu Cheng, Hu, Junjie +9 · 3 citations
Computer Science · #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications
- Bridging the Gap between Stochastic Gradient MCMC and Stochastic Optimization
2015/12/25 by Chen, Changyou, Carlson, David, Gan, Zhe +2 · 2 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone
2022/06/15 by Dou, Zi-Yi, Kamath, Aishwarya, Gan, Zhe +9 · 3 citations
#Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- SlowFast-LLaVA-1.5: A Family of Token-Efficient Video Large Language Models for Long-Form Video Understanding
2025/03/24 by Xu, Mingze, Gao, Mingfei, Li, Shiyu +7 · 9 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- EarlyBERT: Efficient BERT Training via Early-bird Lottery Tickets
2020/12/31 by Xiaohan Chen, Chen, Xiaohan, Yu Cheng +9 · 5 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- VIOLIN: A Large-Scale Dataset for Video-and-Language Inference
2020/03/25 by Jingzhou Liu, Wenhu Chen, Liu, Jingzhou +11 · 3 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Topic-Guided Variational Autoencoders for Text Generation
2019/03/17 by Wang, Wenlin, Gan, Zhe, Xu, Hongteng +5 · 2 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Meta Module Network for Compositional Visual Reasoning
2019/10/08 by Chen, Wenhu, Gan, Zhe, Li, Linjie +3 · 2 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Deep Temporal Sigmoid Belief Networks for Sequence Modeling
2015/09/23 by Zhe Gan, Chunyuan Li, Gan, Zhe +7 · 2 citations
Computer Science · #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Music and Audio Processing #Time Series Analysis and Forecasting
- A Closer Look at the Robustness of Vision-and-Language Pre-trained Models
2020/12/15 by Li, Linjie, Gan, Zhe, Liu, Jingjing · 2 citations
#Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Understanding Alignment in Multimodal LLMs: A Comprehensive Study
2024/07/02 by Elmira Amirloo, Amirloo, Elmira, Jean-Philippe Fauconnier +19 · 4 citations
Computer Science · Arts and Humanities · #Natural Language Processing Techniques #linguistics and terminology studies #Translation Studies and Practices
- Playing Lottery Tickets with Vision and Language
2021/04/23 by Gan, Zhe, Chen, Yen-Chun, Li, Linjie +6 · 2 citations
#Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Improving Zero-shot Voice Style Transfer via Disentangled Representation\n Learning
2021/03/16 by Siyang Yuan, Pengyu Cheng, Yuan, Siyang +9 · 2 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- Apple Intelligence Foundation Language Models: Tech Report 2025
2025/07/17 by Ethan Li, Li, Ethan, Anders Larsen +487 · 14 citations
Computer Science · #Advanced Malware Detection Techniques #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Big Data and Digital Economy #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Contrastively Smoothed Class Alignment for Unsupervised Domain Adaptation
2019/09/11 by Shuyang Dai, Yu Cheng, Dai, Shuyang +9 · 2 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Cancer-related molecular mechanisms research #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications
- UniVG: A Generalist Diffusion Model for Unified Image Generation and Editing
2025/03/16 by Fu, Tsu-Jui, Qian, Yusu, Chen, Chen +3 · 5 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Diagnostic Benchmark and Iterative Inpainting for Layout-Guided Image Generation
2023/04/13 by Cho, Jaemin, Li, Linjie, Yang, Zhengyuan +3 · 2 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Adversarial Symmetric Variational Autoencoder
2017/11/14 by Yunchen Pu, Pu, Yunchen, Weiyao Wang +11 · 2 citations
Computer Science · #Advanced Image Processing Techniques #Adversarial Robustness in Machine Learning #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG)
- Deconvolutional Paragraph Representation Learning
2017/08/16 by Yizhe Zhang, Dinghan Shen, Zhang, Yizhe +9 · 2 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Semantic Compositional Networks for Visual Captioning
2016/11/23 by Gan, Zhe, Gan, Chuang, He, Xiaodong +5 · 1 citation
#Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- JointGAN: Multi-Domain Joint Distribution Learning with Generative Adversarial Nets
2018/06/08 by Yunchen Pu, Pu, Yunchen, Shuyang Dai +13 · 2 citations
Computer Science · #Anomaly Detection Techniques and Applications #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Triangle Generative Adversarial Networks
2017/09/19 by Gan, Zhe, Chen, Liqun, Wang, Weiyao +5 · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- UltraCUA: A Foundation Model for Computer Use Agents with Hybrid Action
2025/10/20 by Yuhao Yang, Yang, Yuhao, Zhen Yang +20 · 5 citations
Computer Science · #Advanced Software Engineering Methodologies #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Reinforcement Learning in Robotics
- Domain Adaptive Text Style Transfer
2019/08/25 by Li, Dianqi, Zhang, Yizhe, Gan, Zhe +4 · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- The Elastic Lottery Ticket Hypothesis
2021/03/30 by Xiaohan Chen, Chen, Xiaohan, Yu Cheng +9 · 1 citation
Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications
- Adversarial Feature Augmentation and Normalization for Visual Recognition
2021/03/22 by Chen, Tianlong, Cheng, Yu, Gan, Zhe +4 · 1 citation
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Simpler, Faster, Stronger: Breaking The log-K Curse On Contrastive Learners With FlatNCE
2021/07/02 by Chen, Junya, Gan, Zhe, Li, Xuan +10 · 1 citation
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Information Theory (cs.IT) #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Revisit Large-Scale Image-Caption Data in Pre-training Multimodal Foundation Models
2024/10/03 by Zhengfeng Lai, Vasileios Saveris, Lai, Zhengfeng +21 · 2 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- Exploring Discrete Diffusion Models for Image Captioning
2022/11/21 by Zixin Zhu, Yixuan Wei, Zhu, Zixin +17 · 1 citation
Computer Science · #Advanced Image and Video Retrieval Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Video Analysis and Summarization
- Learning Generic Sentence Representations Using Convolutional Neural Networks
2016/11/23 by Zhe Gan, Yunchen Pu, Gan, Zhe +9 · 3 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- Improving Sequence-to-Sequence Learning via Optimal Transport
2019/01/18 by Li‐Qun Chen, Yizhe Zhang, Chen, Liqun +17 · 1 citation
Computer Science · #Topic Modeling #Multimodal Machine Learning Applications #Natural Language Processing Techniques
- DeepMMSearch-R1: Empowering Multimodal LLMs in Multimodal Web Search
2025/10/14 by Kartik Narayan, Yang Xu, Narayan, Kartik +16 · 4 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Biomedical Text Mining and Ontologies #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Natural Language Processing Techniques #Semantic Web and Ontologies
- GIE-Bench: Towards Grounded Evaluation for Text-Guided Image Editing
2025/05/16 by Yusu Qian, Qian, Yusu, Jiasen Lü +12 · 2 citations
Arts and Humanities · Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #Digital Humanities and Scholarship #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Multimodal Machine Learning Applications
- Scaling Synthetic Task Generation for Agents via Exploration
2025/09/29 by Ramrakhya, Ram, Szot, Andrew, Attia, Omar +6 · 5 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences