DeepAI AI Chat
Log In Sign Up

Giving Commands to a Self-Driving Car: How to Deal with Uncertain Situations?

by   Thierry Deruyttere, et al.

Current technology for autonomous cars primarily focuses on getting the passenger from point A to B. Nevertheless, it has been shown that passengers are afraid of taking a ride in self-driving cars. One way to alleviate this problem is by allowing the passenger to give natural language commands to the car. However, the car can misunderstand the issued command or the visual surroundings which could lead to uncertain situations. It is desirable that the self-driving car detects these situations and interacts with the passenger to solve them. This paper proposes a model that detects uncertain situations when a command is given and finds the visual objects causing it. Optionally, a question generated by the system describing the uncertain objects is included. We argue that if the car could explain the objects in a human-like way, passengers could gain more confidence in the car's abilities. Thus, we investigate how to (1) detect uncertain situations and their underlying causes, and (2) how to generate clarifying questions for the passenger. When evaluating on the Talk2Car dataset, we show that the proposed model, pipeline, improves m:ambiguous-absolute-increase in terms of IoU_.5 compared to not using pipeline. Furthermore, we designed a referring expression generator (REG) reg_model tailored to a self-driving car setting which yields a relative improvement of m:meteor-relative METEOR and m:rouge-relative ROUGE-l compared with state-of-the-art REG models, and is three times faster.


page 1

page 2

page 8

page 15

page 18

page 23

page 25


Self Driving RC Car using Behavioral Cloning

Self Driving Car technology is a vehicle that guides itself without huma...

Predicting Physical World Destinations for Commands Given to Self-Driving Cars

In recent years, we have seen significant steps taken in the development...

Turning Lemons into Peaches using Secure Computation

In many cases, assessing the quality of goods is hard. For example, when...

GRIP: Graph-based Interaction-aware Trajectory Prediction

Nowadays, autonomous driving cars have become commercially available. Ho...

Maneuver-based Driving for Intervention in Autonomous Cars

The way we communicate with autonomous cars will fundamentally change as...

Applying adversarial networks to increase the data efficiency and reliability of Self-Driving Cars

Convolutional Neural Networks (CNNs) are vulnerable to misclassifying im...

Talk2Car: Taking Control of Your Self-Driving Car

A long-term goal of artificial intelligence is to have an agent execute ...