Pengchuan Zhang
- AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networks
2017/11/28 by Tao Xu, Pengchuan Zhang, Xu, Tao +11 · 1 voice · 22 citations
Computer Science · #Generative Adversarial Networks and Image Synthesis #Human Pose and Action Recognition #Multimodal Machine Learning Applications #cs.CV
- Evaluating Text-to-Visual Generation with Image-to-Text Generation
2024/04/01 by Zhiqiu Lin, Lin, Zhiqiu, Deepak Pathak +13 · 1 voice · 114 citations
Arts and Humanities · Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Digital Humanities and Scholarship #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimedia (cs.MM) #cs.AI #cs.CL #cs.CV #cs.LG #cs.MM
- RegionCLIP: Region-based Language-Image Pretraining
2021/12/16 by Yiwu Zhong, Jianwei Yang, Zhong, Yiwu +19 · 60 citations
Computer Science · Medicine · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #COVID-19 diagnosis using AI
- MiniGPT-v2: large language model as a unified interface for vision-language multi-task learning
2023/10/14 by Jun Chen, Deyao Zhu, Chen, Jun +17 · 72 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Topic Modeling
- Florence: A New Foundation Model for Computer Vision
2021/11/22 by Lu Yuan, Yuan, Lu, Dongdong Chen +43 · 44 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Human Pose and Action Recognition #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- GLIPv2: Unifying Localization and Vision-Language Understanding
2022/06/12 by Haotian Zhang, Zhang, Haotian, Pengchuan Zhang +17 · 21 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Topic Modeling
- Provably Robust Deep Learning via Adversarially Trained Smoothed Classifiers
2019/06/09 by Hadi Salman, Greg Yang, Salman, Hadi +11 · 15 citations
Computer Science · Biochemistry, Genetics and Molecular Biology · #Adversarial Robustness in Machine Learning #Anomaly Detection Techniques and Applications #Bacillus and Francisella bacterial research
- EgoVLPv2: Egocentric Video-Language Pre-training with Fusion in the Backbone
2023/07/11 by Shraman Pramanick, Pramanick, Shraman, Yale Song +13 · 16 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications
- Unified Contrastive Learning in Image-Text-Label Space
2022/04/07 by Jianwei Yang, Chunyuan Li, Yang, Jianwei +11 · 11 citations
Computer Science · Biochemistry, Genetics and Molecular Biology · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Cancer-related molecular mechanisms research
- An Empirical Study of Training End-to-End Vision-and-Language Transformers
2021/11/03 by Zi-Yi Dou, Dou, Zi-Yi, Yichong Xu +21 · 11 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Advanced Neural Network Applications
- SAM 3: Segment Anything with Concepts
2025/11/20 by Nicolas Carion, Laura Gustafson, Carion, Nicolas +73 · 47 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Models
2022/04/19 by Chunyuan Li, Li, Chunyuan, Haotian Liu +19 · 9 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Advanced Neural Network Applications
- Revisiting the Role of Language Priors in Vision-Language Models
2023/06/02 by Zhiqiu Lin, Lin, Zhiqiu, Xinyue Chen +7 · 7 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Topic Modeling
- Understanding the Role of Momentum in Stochastic Gradient Methods
2019/10/30 by Igor Gitman, Hunter Lang, Gitman, Igor +5 · 6 citations
Computer Science · Mathematics · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Markov Chains and Monte Carlo Methods #Numerical methods in inverse problems #Optimization and Control (math.OC) #Stochastic Gradient Optimization Techniques
- VinVL: Revisiting Visual Representations in Vision-Language Models
2021/01/02 by Pengchuan Zhang, Xiujun Li, Xiaowei Hu +5 · 1 voice · 1 citation
Computer Science · #cs.CV #cs.AI #cs.CL #cs.LG
- On the Discrimination-Generalization Tradeoff in GANs
2017/11/07 by Pengchuan Zhang, Zhang, Pengchuan, Qiang Liu +7 · 4 citations
Computer Science · #Evolutionary Algorithms and Applications #Neural Networks and Applications #Cellular Automata and Applications
- The Role of Chain-of-Thought in Complex Vision-Language Reasoning Task
2023/11/15 by Yifan Wu, Wu, Yifan, Pengchuan Zhang +9 · 6 citations
Computer Science · Psychology · #Artificial Intelligence (cs.AI) #Categorization, perception, and language #Cognitive Science and Mapping #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Coarse-to-Fine Contrastive Learning in Image-Text-Graph Space for Improved Vision-Language Compositionality
2023/05/23 by Harman Preet Singh, Pengchuan Zhang, Singh, Harman +11 · 4 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Topic Modeling
- Parameter-efficient Model Adaptation for Vision Transformers
2022/03/29 by Xuehai He, Chunyuan Li, He, Xuehai +7 · 3 citations
Computer Science · Medicine · #Artificial Intelligence (cs.AI) #COVID-19 diagnosis using AI #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- RecurJac: An Efficient Recursive Algorithm for Bounding Jacobian Matrix of Neural Networks and Its Applications
2018/10/28 by Huan Zhang, Zhang, Huan, Pengchuan Zhang +3 · 2 citations
Computer Science · Engineering · #Advanced Memory and Neural Computing #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #FOS: Mathematics #Integrated Circuits and Semiconductor Failure Analysis #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
- Object-driven Text-to-Image Synthesis via Adversarial Training
2019/02/27 by Wenbo Li, Li, Wenbo, Pengchuan Zhang +11 · 2 citations
Computer Science · #Computer Graphics and Visualization Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Multimodal Machine Learning Applications
- Efficient Self-supervised Vision Transformers for Representation Learning
2021/06/17 by Chunyuan Li, Li, Chunyuan, Jianwei Yang +13 · 3 citations
Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- DIME-FM: DIstilling Multimodal and Efficient Foundation Models
2023/03/31 by Ximeng Sun, Pengchuan Zhang, Sun, Ximeng +9 · 3 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- BEHAVIOR Vision Suite: Customizable Dataset Generation via Simulation
2024/05/15 by Yunhao Ge, Yihe Tang, Ge, Yunhao +43 · 2 citations
Computer Science · #Advanced Neural Network Applications
- TLDR: Token-Level Detective Reward Model for Large Vision Language Models
2024/10/07 by Deqing Fu, Fu, Deqing, Tong Xiao +13 · 1 voice · 2 citations
#cs.LG #cs.CL #cs.CV
- Detection Hub: Unifying Object Detection Datasets via Query Adaptation on Language Embedding
2022/06/07 by Lingchen Meng, Meng, Lingchen, Xiyang Dai +17 · 1 citation
Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- Revisiting Kernel Temporal Segmentation as an Adaptive Tokenizer for Long-form Video Understanding
2023/09/20 by Mohamed Afham, Afham, Mohamed, Satya Narayan Shukla +9 · 1 citation
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications #Video Analysis and Summarization