Dhruv Batra
- Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
2019/10/11 by Ramprasaath R. Selvaraju, Michael Cogswell, Abhishek Das +3 · 496 citations
Computer Science · #Explainable Artificial Intelligence (XAI) #Generative Adversarial Networks and Image Synthesis #Multimodal Machine Learning Applications
- VQA: Visual Question Answering
2015/05/03 by Aishwarya Agrawal, Jiasen Lu, Agrawal, Aishwarya +11 · 354 citations
Computer Science · #Multimodal Machine Learning Applications #Advanced Image and Video Retrieval Techniques #Domain Adaptation and Few-Shot Learning
- Visual Dialog
2016/11/26 by Abhishek Das, Satwik Kottur, Das, Abhishek +13 · 2 voices · 19 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Multimodal Machine Learning Applications #Topic Modeling #cs.AI #cs.CL #cs.CV #cs.LG
- Ego4D: Around the World in 3,000 Hours of Egocentric Video
2021/10/13 by Kristen Grauman, Grauman, Kristen, Andrew Westbury +166 · 207 citations
Computer Science · Social Sciences · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Participatory Visual Research Methods #Video Surveillance and Tracking Methods
- ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks
2019/08/06 by Jiasen Lu, Dhruv Batra, Lu, Jiasen +5 · 132 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AI
2021/09/16 by Santhosh Kumar Ramakrishnan, Aaron Gokaslan, Ramakrishnan, Santhosh K. +23 · 99 citations
Engineering · Computer Science · #Robotics and Sensor-Based Localization #Advanced Neural Network Applications #Human Pose and Action Recognition
- Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous\n Environments
2020/04/06 by Jacob Krantz, Erik Wijmans, Krantz, Jacob +7 · 77 citations
Computer Science · #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- A Corpus and Evaluation Framework for Deeper Understanding of\n Commonsense Stories
2016/04/06 by Nasrin Mostafazadeh, Mostafazadeh, Nasrin, Nathanael Chambers +14 · 34 citations
Computer Science · #Advanced Text Analysis Techniques #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- Diverse Beam Search: Decoding Diverse Solutions from Neural Sequence Models
2016/10/07 by Ashwin K. Vijayakumar, Michael Cogswell, Vijayakumar, Ashwin K +11 · 41 citations
Computer Science · #Multimodal Machine Learning Applications #Topic Modeling #Explainable Artificial Intelligence (XAI)
- VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigation
2023/12/06 by Naoki Yokoyama, Sehoon Ha, Yokoyama, Naoki +7 · 64 citations
Computer Science · Engineering · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Robotics and Sensor-Based Localization
- ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objects
2020/06/23 by Dhruv Batra, Aaron Gokaslan, Batra, Dhruv +13 · 32 citations
Computer Science · Engineering · #Multimodal Machine Learning Applications #Reinforcement Learning in Robotics #Robot Manipulation and Learning
- Why M Heads are Better than One: Training a Diverse Ensemble of Deep Networks
2015/11/19 by Stefan Lee, Senthil Purushwalkam, Lee, Stefan +7 · 26 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Machine Learning and Data Classification #Anomaly Detection Techniques and Applications
- Where are we in the search for an Artificial Visual Cortex for Embodied Intelligence?
2023/03/31 by Arjun Majumdar, Karmesh Yadav, Majumdar, Arjun +27 · 39 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Human Pose and Action Recognition #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Robotics (cs.RO)
- Habitat 3.0: A Co-Habitat for Humans, Avatars and Robots
2023/10/19 by Xavier Puig, Puig, Xavier, Eric Undersander +43 · 43 citations
Computer Science · Psychology · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Graphics (cs.GR) #Human-Computer Interaction (cs.HC) #Innovative Human-Technology Interaction #Multiagent Systems (cs.MA) #Robotics (cs.RO) #Social Robot Interaction and HRI
- Grad-CAM: Why did you say that?
2016/11/22 by Ramprasaath R. Selvaraju, Abhishek Das, Selvaraju, Ramprasaath R +9 · 25 citations
Computer Science · #Multimodal Machine Learning Applications #Explainable Artificial Intelligence (XAI) #Domain Adaptation and Few-Shot Learning
- Habitat Synthetic Scenes Dataset (HSSD-200): An Analysis of 3D Scene Scale and Realism Tradeoffs for ObjectGoal Navigation
2023/06/20 by Mukul Khanna, Yongsen Mao, Khanna, Mukul +16 · 35 citations
Computer Science · Engineering · #Multimodal Machine Learning Applications #Advanced Image and Video Retrieval Techniques #Robotics and Sensor-Based Localization
- Waypoint Models for Instruction-guided Navigation in Continuous\n Environments
2021/10/05 by Jacob Krantz, Krantz, Jacob, Aaron Gokaslan +7 · 23 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications #Robotics (cs.RO)
- Counterfactual Visual Explanations
2019/04/16 by Yash Goyal, Goyal, Yash, Ziyan Wu +9 · 16 citations
Computer Science · Biochemistry, Genetics and Molecular Biology · #Explainable Artificial Intelligence (XAI) #Cell Image Analysis Techniques #Machine Learning and Data Classification
- Navigating to Objects in the Real World
2022/12/02 by Théophile Gervet, Gervet, Theophile, Soumith Chintala +7 · 23 citations
Computer Science · Engineering · #Multimodal Machine Learning Applications #Robotics and Sensor-Based Localization #Domain Adaptation and Few-Shot Learning
- GOAT: GO to Any Thing
2023/11/10 by Matthew Chang, Théophile Gervet, Chang, Matthew +23 · 28 citations
Computer Science · Engineering · #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Robotic Path Planning Algorithms #Robotics (cs.RO) #Robotics and Sensor-Based Localization
- Visual Storytelling
2016/04/13 by Ting-Hao, Huang, Francis Ferraro +27 · 14 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Video Analysis and Summarization
- Habitat-Web: Learning Embodied Object-Search Strategies from Human Demonstrations at Scale
2022/04/07 by Ram Ramrakhya, Ramrakhya, Ram, Eric Undersander +5 · 19 citations
Computer Science · Psychology · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Reinforcement Learning in Robotics #Robotics (cs.RO) #Social Robot Interaction and HRI
- Graph R-CNN for Scene Graph Generation
2018/08/01 by Jianwei Yang, Yang, Jianwei, Jiasen Lu +7 · 15 citations
Computer Science · #Multimodal Machine Learning Applications #Advanced Neural Network Applications #Advanced Image and Video Retrieval Techniques
- SoundSpaces 2.0: A Simulation Platform for Visual-Acoustic Learning
2022/06/16 by Changan Chen, Carl Schissler, Chen, Changan +15 · 19 citations
Computer Science · #Audio and Speech Processing (eess.AS) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Multimedia (cs.MM) #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
- Habitat-Matterport 3D Semantics Dataset
2022/10/11 by Karmesh Yadav, Yadav, Karmesh, Ram Ramrakhya +21 · 19 citations
Earth and Planetary Sciences · Engineering · Environmental Science · #3D Surveying and Cultural Heritage #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Remote Sensing and LiDAR Applications #Robotics and Sensor-Based Localization
- PIRLNav: Pretraining with Imitation and RL Finetuning for ObjectNav
2023/01/18 by Ram Ramrakhya, Ramrakhya, Ram, Dhruv Batra +5 · 17 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO)
- Pythia v0.1: the Winning Entry to the VQA Challenge 2018
2018/07/26 by Yu Jiang, Vivek Natarajan, Jiang, Yu +9 · 20 citations
Computer Science · Medicine · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #COVID-19 diagnosis using AI
- Multi-Target Embodied Question Answering
2019/04/09 by Licheng Yu, Yu, Licheng, Xinlei Chen +9 · 10 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Topic Modeling
- HomeRobot: Open-Vocabulary Mobile Manipulation
2023/06/20 by Sriram Yenamandra, Arun Ramachandran, Yenamandra, Sriram +32 · 17 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO)
- Instance-Specific Image Goal Navigation: Training Embodied Agents to Find Object Instances
2022/11/29 by Jacob Krantz, Stefan Lee, Krantz, Jacob +7 · 14 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Single-cell and spatial transcriptomics
- HM3D-OVON: A Dataset and Benchmark for Open-Vocabulary Object Goal Navigation
2024/09/22 by Naoki Yokoyama, Ram Ramrakhya, Yokoyama, Naoki +7 · 24 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling
- Improving Vision-and-Language Navigation with Image-Text Pairs from the\n Web
2020/04/30 by Arjun Majumdar, Ayush Shrivastava, Majumdar, Arjun +9 · 9 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Navigating to Objects Specified by Images
2023/04/03 by Jacob Krantz, Théophile Gervet, Krantz, Jacob +17 · 13 citations
Computer Science · #Multimodal Machine Learning Applications #Advanced Image and Video Retrieval Techniques #Human Pose and Action Recognition
- Offline Visual Representation Learning for Embodied Navigation
2022/04/27 by Karmesh Yadav, Yadav, Karmesh, Ram Ramrakhya +13 · 10 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Human Pose and Action Recognition
- Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysis
2023/12/14 by Yafei Hu, Quanting Xie, Hu, Yafei +38 · 15 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Robotics (cs.RO) #Topic Modeling
- Rearrangement: A Challenge for Embodied AI
2020/11/03 by Dhruv Batra, Batra, Dhruv, Sonia Chernova +20 · 13 citations
Engineering · Computer Science · #Robot Manipulation and Learning #Multimodal Machine Learning Applications #Reinforcement Learning in Robotics
- Stochastic Multiple Choice Learning for Training Diverse Deep Ensembles
2016/06/24 by Stefan Lee, Senthil Purushwalkam, Lee, Stefan +9 · 6 citations
Computer Science · #Advanced Neural Network Applications #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Stochastic Gradient Optimization Techniques
- Human Attention in Visual Question Answering: Do Humans and Deep\n Networks Look at the Same Regions?
2016/06/17 by Abhishek Das, Harsh Agrawal, Das, Abhishek +7 · 6 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (stat.ML) #Multimodal Machine Learning Applications
- Retrospectives on the Embodied AI Workshop
2022/10/13 by Matt Deitke, Dhruv Batra, Deitke, Matt +74 · 6 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications
- Neural Modular Control for Embodied Question Answering
2018/10/26 by Abhishek Das, Das, Abhishek, Georgia Gkioxari +7 · 3 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Topic Modeling
- C-VQA: A Compositional Split of the Visual Question Answering (VQA) v1.0 Dataset
2017/04/26 by Aishwarya Agrawal, Agrawal, Aishwarya, Aniruddha Kembhavi +5 · 5 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- Success Weighted by Completion Time: A Dynamics-Aware Evaluation Criteria for Embodied Navigation
2021/03/14 by Naoki Yokoyama, Sehoon Ha, Yokoyama, Naoki +3 · 3 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Evacuation and Crowd Dynamics #FOS: Computer and information sciences #Reinforcement Learning in Robotics #Robotic Path Planning Algorithms #Robotics (cs.RO)
- Learning Dynamics Model in Reinforcement Learning by Incorporating the Long Term Future
2019/03/05 by Nan Rosemary Ke, Ke, Nan Rosemary, Amanpreet Singh +10 · 4 citations
Computer Science · #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Reinforcement Learning in Robotics
- SOAT: A Scene- and Object-Aware Transformer for Vision-and-Language Navigation
2021/10/27 by Abhinav Moudgil, Arjun Majumdar, Moudgil, Abhinav +7 · 3 citations
Computer Science · #Multimodal Machine Learning Applications #Advanced Image and Video Retrieval Techniques #Domain Adaptation and Few-Shot Learning
- Housekeep: Tidying Virtual Households using Commonsense Reasoning
2022/05/22 by Yash Kant, Arun Ramachandran, Kant, Yash +11 · 3 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Best of Both Worlds: Transferring Knowledge from Discriminative Learning to a Generative Visual Dialog Model
2017/06/05 by Jiasen Lu, Lu, Jiasen, Anitha Kannan +7 · 4 citations
Computer Science · #Multimodal Machine Learning Applications #Topic Modeling #Artificial Intelligence in Games
- VER: Scaling On-Policy RL Leads to the Emergence of Navigation in Embodied Rearrangement
2022/10/11 by Erik Wijmans, Wijmans, Erik, Irfan Essa +3 · 3 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Machine Learning (cs.LG) #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO)
- Auxiliary Tasks Speed Up Learning PointGoal Navigation
2020/07/09 by Joel Ye, Dhruv Batra, Ye, Joel +5 · 3 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Robotics (cs.RO) #Topic Modeling
- Semantic MapNet: Building Allocentric Semantic Maps and Representations\n from Egocentric Views
2020/10/02 by Vincent Cartillier, Zhile Ren, Cartillier, Vincent +9 · 2 citations
Engineering · Computer Science · #Robotics and Sensor-Based Localization #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications
- Learning Navigation Skills for Legged Robots with Learned Robot Embeddings
2020/11/24 by Joanne Truong, Denis Yarats, Truong, Joanne +11 · 2 citations
Computer Science · Engineering · #FOS: Computer and information sciences #Reinforcement Learning in Robotics #Robotic Locomotion and Control #Robotics (cs.RO) #Software Testing and Debugging Techniques
- Neural-Guided Deductive Search for Real-Time Program Synthesis from Examples
2018/04/03 by Ashwin Kalyan, Kalyan, Ashwin, Abhishek Mohta +9 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Parallel Computing and Optimization Techniques #Programming Languages (cs.PL) #Software Engineering Research
- Pre-trained Text-to-Image Diffusion Models Are Versatile Representation Learners for Control
2024/05/09 by Gunshi Gupta, Karmesh Yadav, Gupta, Gunshi +11 · 3 citations
Physics and Astronomy · Computer Science · #Model Reduction and Neural Networks #Machine Learning in Healthcare #Neural Networks and Applications
- Emergence of Maps in the Memories of Blind Navigation Agents
2023/01/30 by Erik Wijmans, Manolis Savva, Wijmans, Erik +9 · 2 citations
Computer Science · #Reinforcement Learning in Robotics #Robotic Path Planning Algorithms #Multimodal Machine Learning Applications
- Radio Transformer Networks: Attention Models for Learning to Synchronize\n in Wireless Systems
2016/05/02 by O'Shea, Timothy J, Latha Pemula, Dhruv Batra +3 · 1 citation
Biochemistry, Genetics and Molecular Biology · Computer Science · Engineering · #FOS: Computer and information sciences #FOS: Electrical engineering #Geophysical Methods and Applications #Machine Learning (cs.LG) #Networking and Internet Architecture (cs.NI) #Spider Taxonomy and Behavior Studies #Systems and Control (eess.SY) #Wireless Signal Modulation Classification #electronic engineering #information engineering
- Visual Curiosity: Learning to Ask Questions to Learn Visual Recognition
2018/10/01 by Jianwei Yang, Jiasen Lu, Yang, Jianwei +7 · 1 citation
Computer Science · #Advanced Image and Video Retrieval Techniques #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Robotics (cs.RO)
- Probabilistic Neural-symbolic Models for Interpretable Visual Question Answering
2019/02/21 by Ramakrishna Vedantam, Karan Desai, Vedantam, Ramakrishna +9 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications #Topic Modeling
- Episodic Memory Question Answering
2022/05/03 by Samyak Datta, Datta, Samyak, Sameer Dharur +11 · 1 citation
Computer Science · #Multimodal Machine Learning Applications #Human Pose and Action Recognition #Augmented Reality Applications
- CoDraw: Collaborative Drawing as a Testbed for Grounded Goal-driven Communication
2017/12/15 by Jin-Hwa Kim, Kim, Jin-Hwa, Nikita Kitaev +13 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Human Pose and Action Recognition #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- Adaptive Coordination in Social Embodied Rearrangement
2023/05/31 by Andrew Szot, Szot, Andrew, Unnat Jain +9 · 1 citation
Computer Science · Psychology · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multiagent Systems (cs.MA) #Multimodal Machine Learning Applications #Reinforcement Learning in Robotics #Robotics (cs.RO) #Social Robot Interaction and HRI
- Towards Open-World Mobile Manipulation in Homes: Lessons from the Neurips 2023 HomeRobot Open Vocabulary Mobile Manipulation Challenge
2024/07/09 by Sriram Yenamandra, Yenamandra, Sriram, Arun Ramachandran +87 · 1 citation
Computer Science · Engineering · #AI in Service Interactions #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Robot Manipulation and Learning #Robotics (cs.RO) #Robotics and Automated Systems
- End-to-End Audio Visual Scene-Aware Dialog using Multimodal Attention-Based Video Features
2018/06/21 by Chiori Hori, Huda Alamri, Hori, Chiori +23 · 1 citation
Computer Science · #Multimodal Machine Learning Applications #Human Pose and Action Recognition #Video Analysis and Summarization