vix.ing · top · new · best · stats

Navigational Instruction Generation as Inverse Reinforcement Learning with Neural Machine Translation

2016/10/10 by Andrea F. Daniele, Mohit Bansal, Daniele, Andrea F. +3
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Robotics (cs.RO) #Topic Modeling #cs.AI #cs.CL #cs.LG #cs.RO

paper · pdf · doi:10.48550/arxiv.1610.03164

openalex publication_date 2016/10/10 · arxiv created 2016/10/11 · arxiv updated 2016/10/12 · openalex created_date 2022/10/05 · openalex updated_date 2026/07/28

Abstract

Modern robotics applications that involve human-robot interaction require robots to be able to communicate with humans seamlessly and effectively. Natural language provides a flexible and efficient medium through which robots can exchange information with their human partners. Significant advancements have been made in developing robots capable of interpreting free-form instructions, but less attention has been devoted to endowing robots with the ability to generate natural language. We propose a navigational guide model that enables robots to generate natural language instructions that allow humans to navigate a priori unknown environments. We first decide which information to share with the user according to their preferences, using a policy trained from human demonstrations via inverse reinforcement learning. We then "translate" this information into a natural language instruction using a neural sequence-to-sequence model that learns to generate free-form instructions from natural language corpora. We evaluate our method on a benchmark route instruction dataset and achieve a BLEU score of 72.18% when compared to human-generated reference instructions. We additionally conduct navigation experiments with human participants that demonstrate that our method generates instructions that people follow as accurately and easily as those produced by humans.

Citations

Related