Incorporating Orientations into End-to-end Driving Model for Steering Control

03/10/2021
by   Peng Wan, et al.
0

In this paper, we present a novel end-to-end deep neural network model for autonomous driving that takes monocular image sequence as input, and directly generates the steering control angle. Firstly, we model the end-to-end driving problem as a local path planning process. Inspired by the environmental representation in the classical planning algorithms(i.e. the beam curvature method), pixel-wise orientations are fed into the network to learn direction-aware features. Next, to handle the imbalanced distribution of steering values in training datasets, we propose an improvement on a cost-sensitive loss function named SteeringLoss2. Besides, we also present a new end-to-end driving dataset, which provides corresponding LiDAR and image sequences, as well as standard driving behaviors. Our dataset includes multiple driving scenarios, such as urban, country, and off-road. Numerous experiments are conducted on both public available LiVi-Set and our own dataset, and the results show that the model using our proposed methods can predict steering angle accurately.

READ FULL TEXT

page 3

page 12

research
01/20/2018

End-to-end Multi-Modal Multi-Task Vehicle Control for Self-Driving Cars with Visual Perception

Convolutional Neural Networks (CNN) have been successfully applied to au...
research
08/20/2018

End to End Vehicle Lateral Control Using a Single Fisheye Camera

Convolutional neural networks are commonly used to control the steering ...
research
05/19/2018

End-to-end driving simulation via angle branched network

Imitation learning for end-to-end autonomous driving has drawn attention...
research
08/03/2020

PillarFlow: End-to-end Birds-eye-view Flow Estimation for Autonomous Driving

In autonomous driving, accurately estimating the state of surrounding ob...
research
04/17/2023

PaaS: Planning as a Service for reactive driving in CARLA Leaderboard

End-to-end deep learning approaches has been proven to be efficient in a...
research
12/28/2016

The Predictron: End-To-End Learning and Planning

One of the key challenges of artificial intelligence is to learn models ...
research
02/09/2019

Hierarchical Multi-task Deep Neural Network Architecture for End-to-End Driving

A novel hierarchical Deep Neural Network (DNN) model is presented to add...

Please sign up or login with your details

Forgot password? Click here to reset