vix.ing · top · new · best · stats · spec

Altruistic Decision-Making for Autonomous Driving with Sparse Rewards

2020/07/14 by Jack Geary, Geary, Jack, Henry Gouk +1
Computer Science · Decision Sciences · Engineering · #Computer Science and Game Theory (cs.GT) #FOS: Computer and information sciences #Game Theory and Applications #Multiagent Systems (cs.MA) #Reinforcement Learning in Robotics #Traffic control and management

paper · doi:10.48550/arxiv.2007.07182

openalex publication_date 2020/07/14 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

In order to drive effectively, a driver must be aware of how they can expect other vehicles' behaviour to be affected by their decisions, and also how they are expected to behave by other drivers. One common family of methods for addressing this problem of interaction are those based on Game Theory. Such approaches often make assumptions about leaders and followers in an interaction which can result in conflicts arising when vehicles do not agree on the hierarchy, resulting in sub-optimal behaviour. In this work we define a measurement for the incidence of conflicts, Area of Conflict (AoC), for a given interactive decision-making model. Furthermore, we propose a novel decision-making method that reduces this value compared to an existing approach for incorporating altruistic behaviour. We verify our theoretical analysis empirically using a simulated lane-change scenario.

Related