Zhang, Pengchuan
- The Llama 3 Herd of Models
2024/07/31 by Grattafiori, Aaron, Dubey, Abhimanyu, Jauhri, Abhinav +556 · 2748 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networks
2017/11/28 by Tao Xu, Xu, Tao, Pengchuan Zhang +11 · 1 voice · 22 citations
Computer Science · #Generative Adversarial Networks and Image Synthesis #Human Pose and Action Recognition #Multimodal Machine Learning Applications #cs.CV
- Grounded Language-Image Pre-training
2021/12/07 by Li, Liunian Harold, Zhang, Pengchuan, Zhang, Haotian +9 · 127 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimedia (cs.MM)
- Evaluating Text-to-Visual Generation with Image-to-Text Generation
2024/04/01 by Zhiqiu Lin, Lin, Zhiqiu, Deepak Pathak +13 · 1 voice · 115 citations
Arts and Humanities · Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Digital Humanities and Scholarship #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimedia (cs.MM) #cs.AI #cs.CL #cs.CV #cs.LG #cs.MM
- RegionCLIP: Region-based Language-Image Pretraining
2021/12/16 by Yiwu Zhong, Zhong, Yiwu, Jianwei Yang +19 · 61 citations
Computer Science · Medicine · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #COVID-19 diagnosis using AI
- MiniGPT-v2: large language model as a unified interface for vision-language multi-task learning
2023/10/14 by Jun Chen, Deyao Zhu, Chen, Jun +17 · 73 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Topic Modeling
- Florence: A New Foundation Model for Computer Vision
2021/11/22 by Lu Yuan, Dongdong Chen, Yuan, Lu +43 · 47 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Human Pose and Action Recognition #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks
2020/04/13 by Li, Xiujun, Yin, Xi, Li, Chunyuan +9 · 33 citations
#Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Machine Learning (cs.LG)
- UniVTG: Towards Unified Video-Language Temporal Grounding
2023/07/31 by Lin, Kevin Qinghong, Zhang, Pengchuan, Chen, Joya +5 · 33 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- GLIPv2: Unifying Localization and Vision-Language Understanding
2022/06/12 by Haotian Zhang, Pengchuan Zhang, Zhang, Haotian +17 · 21 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Topic Modeling
- GenAI-Bench: Evaluating and Improving Compositional Text-to-Visual Generation
2024/06/19 by Li, Baiqi, Lin, Zhiqiu, Pathak, Deepak +8 · 30 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimedia (cs.MM)
- Provably Robust Deep Learning via Adversarially Trained Smoothed Classifiers
2019/06/09 by Hadi Salman, Salman, Hadi, Greg Yang +11 · 15 citations
Computer Science · Biochemistry, Genetics and Molecular Biology · #Adversarial Robustness in Machine Learning #Anomaly Detection Techniques and Applications #Bacillus and Francisella bacterial research
- Focal Self-attention for Local-Global Interactions in Vision Transformers
2021/07/01 by Yang, Jianwei, Li, Chunyuan, Zhang, Pengchuan +4 · 11 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- EgoVLPv2: Egocentric Video-Language Pre-training with Fusion in the Backbone
2023/07/11 by Shraman Pramanick, Yale Song, Pramanick, Shraman +13 · 16 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications
- Unified Contrastive Learning in Image-Text-Label Space
2022/04/07 by Jianwei Yang, Chunyuan Li, Yang, Jianwei +11 · 12 citations
Computer Science · Biochemistry, Genetics and Molecular Biology · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Cancer-related molecular mechanisms research
- An Empirical Study of Training End-to-End Vision-and-Language Transformers
2021/11/03 by Zi-Yi Dou, Yichong Xu, Dou, Zi-Yi +21 · 12 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Advanced Neural Network Applications
- SAM 3: Segment Anything with Concepts
2025/11/20 by Nicolas Carion, Carion, Nicolas, Laura Gustafson +73 · 47 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Models
2022/04/19 by Chunyuan Li, Haotian Liu, Li, Chunyuan +19 · 9 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Advanced Neural Network Applications
- TIGEr: Text-to-Image Grounding for Image Caption Evaluation
2019/09/04 by Jiang, Ming, Huang, Qiuyuan, Zhang, Lei +5 · 5 citations
#Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- K-LITE: Learning Transferable Visual Models with External Knowledge
2022/04/20 by Shen, Sheng, Li, Chunyuan, Hu, Xiaowei +11 · 6 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Revisiting the Role of Language Priors in Vision-Language Models
2023/06/02 by Zhiqiu Lin, Xinyue Chen, Lin, Zhiqiu +7 · 7 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Topic Modeling
- Understanding the Role of Momentum in Stochastic Gradient Methods
2019/10/30 by Igor Gitman, Hunter Lang, Gitman, Igor +5 · 6 citations
Computer Science · Mathematics · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Markov Chains and Monte Carlo Methods #Numerical methods in inverse problems #Optimization and Control (math.OC) #Stochastic Gradient Optimization Techniques
- Missingness Bias in Model Debugging
2022/04/19 by Jain, Saachi, Salman, Hadi, Wong, Eric +4 · 5 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encoding
2021/03/29 by Zhang, Pengchuan, Dai, Xiyang, Yang, Jianwei +4 · 4 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- On the Discrimination-Generalization Tradeoff in GANs
2017/11/07 by Pengchuan Zhang, Zhang, Pengchuan, Qiang Liu +7 · 4 citations
Computer Science · #Evolutionary Algorithms and Applications #Neural Networks and Applications #Cellular Automata and Applications
- The Role of Chain-of-Thought in Complex Vision-Language Reasoning Task
2023/11/15 by Yifan Wu, Wu, Yifan, Pengchuan Zhang +9 · 6 citations
Computer Science · Psychology · #Artificial Intelligence (cs.AI) #Categorization, perception, and language #Cognitive Science and Mapping #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- A Convex Relaxation Barrier to Tight Robustness Verification of Neural Networks
2019/02/23 by Salman, Hadi, Yang, Greg, Zhang, Huan +2 · 3 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- DIME-FM: DIstilling Multimodal and Efficient Foundation Models
2023/03/31 by Ximeng Sun, Pengchuan Zhang, Sun, Ximeng +9 · 4 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- Coarse-to-Fine Contrastive Learning in Image-Text-Graph Space for Improved Vision-Language Compositionality
2023/05/23 by Harman Preet Singh, Pengchuan Zhang, Singh, Harman +11 · 4 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Topic Modeling
- Parameter-efficient Model Adaptation for Vision Transformers
2022/03/29 by Xuehai He, He, Xuehai, Chunyuan Li +7 · 3 citations
Computer Science · Medicine · #Artificial Intelligence (cs.AI) #COVID-19 diagnosis using AI #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone
2022/06/15 by Dou, Zi-Yi, Kamath, Aishwarya, Gan, Zhe +9 · 3 citations
#Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- RecurJac: An Efficient Recursive Algorithm for Bounding Jacobian Matrix of Neural Networks and Its Applications
2018/10/28 by Huan Zhang, Zhang, Huan, Pengchuan Zhang +3 · 2 citations
Computer Science · Engineering · #Advanced Memory and Neural Computing #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #FOS: Mathematics #Integrated Circuits and Semiconductor Failure Analysis #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
- Object-driven Text-to-Image Synthesis via Adversarial Training
2019/02/27 by Wenbo Li, Pengchuan Zhang, Li, Wenbo +11 · 2 citations
Computer Science · #Computer Graphics and Visualization Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Multimodal Machine Learning Applications
- Efficient Self-supervised Vision Transformers for Representation Learning
2021/06/17 by Chunyuan Li, Jianwei Yang, Li, Chunyuan +13 · 3 citations
Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- Exploring the locally low dimensional structure in solving random elliptic PDEs
2016/07/03 by Hou, Thomas Y., Li, Qin, Zhang, Pengchuan · 1 citation
#FOS: Mathematics #Numerical Analysis (math.NA)
- BEHAVIOR Vision Suite: Customizable Dataset Generation via Simulation
2024/05/15 by Yunhao Ge, Ge, Yunhao, Yihe Tang +43 · 2 citations
Computer Science · #Advanced Neural Network Applications
- Using Statistics to Automate Stochastic Optimization
2019/09/21 by Lang, Hunter, Zhang, Pengchuan, Xiao, Lin · 1 citation
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- TLDR: Token-Level Detective Reward Model for Large Vision Language Models
2024/10/07 by Deqing Fu, Fu, Deqing, Tong Xiao +13 · 1 voice · 2 citations
#cs.LG #cs.CL #cs.CV
- MiniVLM: A Smaller and Faster Vision-Language Model
2020/12/13 by Wang, Jianfeng, Hu, Xiaowei, Zhang, Pengchuan +5 · 1 citation
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- 3DB: A Framework for Debugging Computer Vision Models
2021/06/07 by Leclerc, Guillaume, Salman, Hadi, Ilyas, Andrew +9 · 1 citation
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Learning Video Context as Interleaved Multimodal Sequences
2024/07/31 by Lin, Kevin Qinghong, Zhang, Pengchuan, Gao, Difei +6 · 2 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimedia (cs.MM)
- Detection Hub: Unifying Object Detection Datasets via Query Adaptation on Language Embedding
2022/06/07 by Lingchen Meng, Xiyang Dai, Meng, Lingchen +17 · 1 citation
Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- Revisiting Kernel Temporal Segmentation as an Adaptive Tokenizer for Long-form Video Understanding
2023/09/20 by Mohamed Afham, Afham, Mohamed, Satya Narayan Shukla +9 · 1 citation
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications #Video Analysis and Summarization