Devi Parikh
- Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
2019/10/11 by Ramprasaath R. Selvaraju, Michael Cogswell, Abhishek Das +3 · 595 citations
Computer Science · #Explainable Artificial Intelligence (XAI) #Generative Adversarial Networks and Image Synthesis #Multimodal Machine Learning Applications
- VQA: Visual Question Answering
2015/05/03 by Aishwarya Agrawal, Jiasen Lu, Agrawal, Aishwarya +11 · 454 citations
Computer Science · #Multimodal Machine Learning Applications #Advanced Image and Video Retrieval Techniques #Domain Adaptation and Few-Shot Learning
- Make-A-Video: Text-to-Video Generation without Text-Video Data
2022/09/29 by Uriel Singer, Adam Polyak, Singer, Uriel +23 · 1 voice · 188 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Video Analysis and Summarization #cs.AI #cs.CV #cs.LG
- Visual Dialog
2016/11/26 by Abhishek Das, Das, Abhishek, Satwik Kottur +13 · 2 voices · 25 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Multimodal Machine Learning Applications #Topic Modeling #cs.AI #cs.CL #cs.CV #cs.LG
- CIDEr: Consensus-based Image Description Evaluation
2014/11/20 by Ramakrishna Vedantam, C. Lawrence Zitnick, Vedantam, Ramakrishna +3 · 219 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Multimodal Machine Learning Applications
- ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks
2019/08/06 by Jiasen Lu, Dhruv Batra, Lu, Jiasen +5 · 147 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- A Corpus and Evaluation Framework for Deeper Understanding of\n Commonsense Stories
2016/04/06 by Nasrin Mostafazadeh, Nathanael Chambers, Mostafazadeh, Nasrin +14 · 42 citations
Computer Science · #Advanced Text Analysis Techniques #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- AudioGen: Textually Guided Audio Generation
2022/09/30 by Felix Kreuk, Kreuk, Felix, Gabriel Synnaeve +15 · 54 citations
Computer Science · #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- Emu Edit: Precise Image Editing via Recognition and Generation Tasks
2023/11/16 by Shelly Sheynin, Sheynin, Shelly, Adam Polyak +13 · 65 citations
Computer Science · Biochemistry, Genetics and Molecular Biology · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Cell Image Analysis Techniques
- Don't Just Assume; Look and Answer: Overcoming Priors for Visual\n Question Answering
2017/12/01 by Aishwarya Agrawal, Agrawal, Aishwarya, Dhruv Batra +5 · 31 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- Embodied Question Answering
2017/11/30 by Abhishek Das, Das, Abhishek, Samyak Datta +9 · 31 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Robotics and Automated Systems #Speech and dialogue systems
- Grad-CAM: Why did you say that?
2016/11/22 by Ramprasaath R. Selvaraju, Abhishek Das, Selvaraju, Ramprasaath R +9 · 31 citations
Computer Science · #Multimodal Machine Learning Applications #Explainable Artificial Intelligence (XAI) #Domain Adaptation and Few-Shot Learning
- Text-To-4D Dynamic Scene Generation
2023/01/26 by Uriel Singer, Singer, Uriel, Shelly Sheynin +19 · 36 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Handwritten Text Recognition Techniques #Human Motion and Animation #Machine Learning (cs.LG) #Video Analysis and Summarization
- Hierarchical Question-Image Co-Attention for Visual Question Answering
2016/05/31 by Jiasen Lu, Lu, Jiasen, Jianwei Yang +5 · 27 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- Visual Storytelling
2016/04/13 by Ting-Hao, Francis Ferraro, Huang +27 · 21 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Video Analysis and Summarization
- Counterfactual Visual Explanations
2019/04/16 by Yash Goyal, Goyal, Yash, Ziyan Wu +9 · 22 citations
Computer Science · Biochemistry, Genetics and Molecular Biology · #Explainable Artificial Intelligence (XAI) #Cell Image Analysis Techniques #Machine Learning and Data Classification
- Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priors
2022/03/24 by Oran Gafni, Gafni, Oran, Adam Polyak +9 · 25 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Graphics (cs.GR) #Human Motion and Animation #Machine Learning (cs.LG) #Video Analysis and Summarization
- Emu: Enhancing Image Generation Models Using Photogenic Needles in a Haystack
2023/09/27 by Xiaoliang Dai, Dai, Xiaoliang, Ji Hou +54 · 1 voice · 29 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Image Retrieval and Classification Techniques #Multimodal Machine Learning Applications #cs.CV
- Long Video Generation with Time-Agnostic VQGAN and Time-Sensitive Transformer
2022/04/07 by Songwei Ge, Thomas Hayes, Ge, Songwei +13 · 24 citations
Computer Science · #Advanced Vision and Imaging #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Video Analysis and Summarization
- Graph R-CNN for Scene Graph Generation
2018/08/01 by Jianwei Yang, Jiasen Lu, Yang, Jianwei +7 · 17 citations
Computer Science · #Multimodal Machine Learning Applications #Advanced Neural Network Applications #Advanced Image and Video Retrieval Techniques
- Deep Learning the City : Quantifying Urban Perception At A Global Scale
2016/08/05 by Abhimanyu Dubey, Nikhil Naik, Dubey, Abhimanyu +7 · 14 citations
Computer Science · Environmental Science · Social Sciences · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Mobility and Location-Based Analysis #Impact of Light on Environment and Health #Video Surveillance and Tracking Methods
- Emu Video: Factorizing Text-to-Video Generation by Explicit Image Conditioning
2023/11/17 by Rohit Girdhar, Mannat Singh, Girdhar, Rohit +17 · 26 citations
Computer Science · Social Sciences · #Video Analysis and Summarization #Digital Games and Media #Generative Adversarial Networks and Image Synthesis
- Knowing When to Look: Adaptive Attention via A Visual Sentinel for Image Captioning
2016/12/06 by Jiasen Lu, Lu, Jiasen, Caiming Xiong +5 · 22 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Advanced Image and Video Retrieval Techniques
- Pythia v0.1: the Winning Entry to the VQA Challenge 2018
2018/07/26 by Yu Jiang, Vivek Natarajan, Jiang, Yu +9 · 23 citations
Computer Science · Medicine · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #COVID-19 diagnosis using AI
- Embodied Question Answering in Photorealistic Environments with Point\n Cloud Perception
2019/04/06 by Erik Wijmans, Samyak Datta, Wijmans, Erik +15 · 12 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Human Pose and Action Recognition #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- Improving Vision-and-Language Navigation with Image-Text Pairs from the\n Web
2020/04/30 by Arjun Majumdar, Majumdar, Arjun, Ayush Shrivastava +9 · 11 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Human Attention in Visual Question Answering: Do Humans and Deep\n Networks Look at the Same Regions?
2016/06/17 by Abhishek Das, Das, Abhishek, Harsh Agrawal +7 · 7 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (stat.ML) #Multimodal Machine Learning Applications
- KRISP: Integrating Implicit and Symbolic Knowledge for Open-Domain\n Knowledge-Based VQA
2020/12/20 by Kenneth Marino, Marino, Kenneth, Xinlei Chen +7 · 7 citations
Computer Science · #Multimodal Machine Learning Applications #Topic Modeling #Natural Language Processing Techniques
- An Introduction to Electrocatalyst Design using Machine Learning for Renewable Energy Storage
2020/10/14 by C. Lawrence Zitnick, Zitnick, C. Lawrence, Lowik Chanussot +32 · 7 citations
Energy · Engineering · Materials Science · #Computational Engineering #Electrocatalysts for Energy Conversion #FOS: Computer and information sciences #FOS: Physical sciences #Finance #Fuel Cells and Related Materials #Hybrid Renewable Energy Systems #I.2.6 #J.2 #Machine Learning (cs.LG) #Machine Learning in Materials Science #Materials Science (cond-mat.mtrl-sci) #and Science (cs.CE)
- Make-An-Animation: Large-Scale Text-conditional 3D Human Motion Generation
2023/05/16 by Samaneh Azadi, Akbar Shah, Azadi, Samaneh +7 · 9 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Human Motion and Animation #Human Pose and Action Recognition
- Neural Modular Control for Embodied Question Answering
2018/10/26 by Abhishek Das, Das, Abhishek, Georgia Gkioxari +7 · 5 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Topic Modeling
- It Takes Two to Tango: Towards Theory of AI's Mind
2017/04/03 by Arjun Chandrasekaran, Chandrasekaran, Arjun, Yadav, Deshraj +6 · 8 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Visual Attention and Saliency Detection
- ForceNet: A Graph Neural Network for Large-Scale Quantum Calculations
2021/03/02 by Weihua Hu, Hu, Weihua, Muhammed Shuaibi +13 · 7 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · Materials Science · #Computational Drug Discovery Methods #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning in Materials Science #Protein Structure and Dynamics
- Video Editing via Factorized Diffusion Distillation
2024/03/14 by Uriel Singer, Singer, Uriel, Amit Zohar +11 · 9 citations
Engineering · #Innovative Microfluidic and Catalytic Techniques Innovation
- C-VQA: A Compositional Split of the Visual Question Answering (VQA) v1.0 Dataset
2017/04/26 by Aishwarya Agrawal, Aniruddha Kembhavi, Agrawal, Aishwarya +5 · 7 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- 12-in-1: Multi-Task Vision and Language Representation Learning
2019/12/05 by Jiasen Lu, Vedanuj Goswami, Lu, Jiasen +7 · 4 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Topic Modeling
- Context-aware Captions from Context-agnostic Supervision
2017/01/11 by Ramakrishna Vedantam, Vedantam, Ramakrishna, Samy Bengio +7 · 7 citations
Computer Science · #Multimodal Machine Learning Applications #Human Pose and Action Recognition #Domain Adaptation and Few-Shot Learning
- Best of Both Worlds: Transferring Knowledge from Discriminative Learning to a Generative Visual Dialog Model
2017/06/05 by Jiasen Lu, Anitha Kannan, Lu, Jiasen +7 · 7 citations
Computer Science · #Multimodal Machine Learning Applications #Topic Modeling #Artificial Intelligence in Games
- Creative Sketch Generation
2020/11/19 by Songwei Ge, Ge, Songwei, Vedanuj Goswami +5 · 4 citations
Computer Science · Engineering · #3D Shape Modeling and Analysis #Artificial Intelligence (cs.AI) #Computer Graphics and Visualization Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Motion and Animation
- Lemotif: An Affective Visual Journal Using Deep Neural Networks
2019/03/18 by Xingyu Li, Devi Parikh, Li, X. Alice +1 · 3 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Human-Computer Interaction (cs.HC) #Sentiment Analysis and Opinion Mining #Video Analysis and Summarization
- Learning Dynamics Model in Reinforcement Learning by Incorporating the Long Term Future
2019/03/05 by Nan Rosemary Ke, Amanpreet Singh, Ke, Nan Rosemary +10 · 5 citations
Computer Science · #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Reinforcement Learning in Robotics
- Probabilistic Neural-symbolic Models for Interpretable Visual Question Answering
2019/02/21 by Ramakrishna Vedantam, Vedantam, Ramakrishna, Karan Desai +9 · 3 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications #Topic Modeling
- Visual Curiosity: Learning to Ask Questions to Learn Visual Recognition
2018/10/01 by Jianwei Yang, Yang, Jianwei, Jiasen Lu +7 · 1 citation
Computer Science · #Advanced Image and Video Retrieval Techniques #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Robotics (cs.RO)
- Trick or TReAT: Thematic Reinforcement for Artistic Typography
2019/03/19 by Purva Tendulkar, Tendulkar, Purva, Kalpesh Krishna +5 · 1 citation
Arts and Humanities · Computer Science · #Visual Culture and Art Theory #Digital Humanities and Scholarship #Digital Media and Visual Art
- CoDraw: Collaborative Drawing as a Testbed for Grounded Goal-driven Communication
2017/12/15 by Jin-Hwa Kim, Nikita Kitaev, Kim, Jin-Hwa +13 · 3 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Human Pose and Action Recognition #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- Evaluating Visual Conversational Agents via Cooperative Human-AI Games
2017/08/17 by Prithvijit Chattopadhyay, Chattopadhyay, Prithvijit, Yadav, Deshraj +12 · 2 citations
Computer Science · Medicine · Social Sciences · #AI in Service Interactions #Artificial Intelligence (cs.AI) #Artificial Intelligence in Healthcare and Education #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Ethics and Social Impacts of AI #FOS: Computer and information sciences #Human-Computer Interaction (cs.HC)
- Episodic Memory Question Answering
2022/05/03 by Samyak Datta, Datta, Samyak, Sameer Dharur +11 · 1 citation
Computer Science · #Multimodal Machine Learning Applications #Human Pose and Action Recognition #Augmented Reality Applications
- MUGEN: A Playground for Video-Audio-Text Multimodal Understanding and GENeration
2022/04/17 by Thomas Hayes, Hayes, Thomas, Songyang Zhang +15 · 1 citation
Computer Science · #Music and Audio Processing #Multimodal Machine Learning Applications #Natural Language Processing Techniques
- End-to-End Audio Visual Scene-Aware Dialog using Multimodal Attention-Based Video Features
2018/06/21 by Chiori Hori, Hori, Chiori, Huda Alamri +23 · 1 citation
Computer Science · #Multimodal Machine Learning Applications #Human Pose and Action Recognition #Video Analysis and Summarization