Survey of Recent Advances in Visual Question Answering

2017/09/24 by Supriya Pandhre, Shagun Sodhani, Pandhre, Supriya +1
Computer Science · #Multimodal Machine Learning Applications #Advanced Image and Video Retrieval Techniques #Human Pose and Action Recognition

paper · pdf · doi:10.48550/arxiv.1709.08203

Abstract

Visual Question Answering (VQA) presents a unique challenge as it requires the ability to understand and encode the multi-modal inputs - in terms of image processing and natural language processing. The algorithm further needs to learn how to perform reasoning over this multi-modal representation so it can answer the questions correctly. This paper presents a survey of different approaches proposed to solve the problem of Visual Question Answering. We also describe the current state of the art model in later part of paper. In particular, the paper describes the approaches taken by various algorithms to extract image features, text features and the way these are employed to predict answers. We also briefly discuss the experiments performed to evaluate the VQA models and report their performances on diverse datasets including newly released VQA2.0[8].

Citations

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• VQA: Visual Question Answering

Related

• Visual Question Answering: A Survey of Methods and Datasets
• Visual Question Answering: A Survey on Techniques and Common Trends in Recent Literature
• Answer Them All! Toward Universal Visual Question Answering Models
• Survey of Visual Question Answering: Datasets and Techniques
• Visual Question Answering using Deep Learning: A Survey and Performance Analysis