An FPGA-Accelerated Design for Deep Learning Pedestrian Detection in Self-Driving Vehicles

by   Abdallah Moussawi, et al.

With the rise of self-driving vehicles comes the risk of accidents and the need for higher safety, and protection for pedestrian detection in the following scenarios: imminent crashes, thus the car should crash into an object and avoid the pedestrian, and in the case of road intersections, where it is important for the car to stop when pedestrians are crossing. Currently, a special topology of deep neural networks called Fused Deep Neural Network (F-DNN) is considered to be the state of the art in pedestrian detection, as it has the lowest miss rate, yet it is very slow. Therefore, acceleration is needed to speed up the performance. This project proposes two contributions to address this problem, by using a deep neural network used for object detection, called Single Shot Multi-Box Detector (SSD). The first contribution is training and tuning the hyperparameters of SSD to improve pedestrian detection. The second contribution is a new FPGA design for accelerating the model on the Altera Arria 10 platform. The final system will be used in self-driving vehicles in real-time. Preliminary results of the improved SSD shows 3 miss-rate than F-DNN on Caltech pedestrian detection benchmark, but 4x performance improvement. The acceleration design is expected to achieve an additional performance improvement significantly outweighing the minimal difference in accuracy.


page 1

page 2

page 3

page 4


Enabling Pedestrian Safety using Computer Vision Techniques: A Case Study of the 2018 Uber Inc. Self-driving Car Crash

Human lives are important. The decision to allow self-driving vehicles o...

Fused DNN: A deep neural network fusion approach to fast and robust pedestrian detection

We propose a deep neural network fusion architecture for fast and robust...

A Follow-the-Leader Strategy using Hierarchical Deep Neural Networks with Grouped Convolutions

The task of following-the-leader is implemented using a hierarchical Dee...

Real-time Pedestrian Detection Approach with an Efficient Data Communication Bandwidth Strategy

Vehicle-to-Pedestrian (V2P) communication can significantly improve pede...

Utility Decomposition with Deep Corrections for Scalable Planning under Uncertainty

Decomposition methods have been proposed in the past to approximate solu...

aUToTrack: A Lightweight Object Detection and Tracking System for the SAE AutoDrive Challenge

The University of Toronto is one of eight teams competing in the SAE Aut...

Mapping DNN Embedding Manifolds for Network Generalization Prediction

Understanding Deep Neural Network (DNN) performance in changing conditio...

Please sign up or login with your details

Forgot password? Click here to reset