DeepAI AI Chat
Log In Sign Up

Active Altruism Learning and Information Sufficiency for Autonomous Driving

10/09/2021
by   Jack Geary, et al.
0

Safe interaction between vehicles requires the ability to choose actions that reveal the preferences of the other vehicles. Since exploratory actions often do not directly contribute to their objective, an interactive vehicle must also able to identify when it is appropriate to perform them. In this work we demonstrate how Active Learning methods can be used to incentivise an autonomous vehicle (AV) to choose actions that reveal information about the altruistic inclinations of another vehicle. We identify a property, Information Sufficiency, that a reward function should have in order to keep exploration from unnecessarily interfering with the pursuit of an objective. We empirically demonstrate that reward functions that do not have Information Sufficiency are prone to inadequate exploration, which can result in sub-optimal behaviour. We propose a reward definition that has Information Sufficiency, and show that it facilitates an AV choosing exploratory actions to estimate altruistic tendency, whilst also compensating for the possibility of conflicting beliefs between vehicles.

READ FULL TEXT
10/07/2020

Modeling Human Driving Behavior in Highway Scenario using Inverse Reinforcement Learning

Human driving behavior modeling is of great importance for designing saf...
01/29/2019

Safe, Efficient, and Comfortable Velocity Control based on Reinforcement Learning for Autonomous Driving

A model used for velocity control during car following was proposed base...
06/26/2019

NeuroTrajectory: A Neuroevolutionary Approach to Local State Trajectory Learning for Autonomous Vehicles

Autonomous vehicles are controlled today either based on sequences of de...
04/05/2022

Inferring Rewards from Language in Context

In classic instruction following, language like "I'd like the JetBlue fl...
07/14/2020

Altruistic Decision-Making for Autonomous Driving with Sparse Rewards

In order to drive effectively, a driver must be aware of how they can ex...
02/23/2021

Grounded Relational Inference: Domain Knowledge Driven Explainable Autonomous Driving

Explainability is essential for autonomous vehicles and other robotics s...