FisheyeMultiNet: Real-time Multi-task Learning Architecture for Surround-view Automated Parking System

12/23/2019
by   Pullarao Maddu, et al.
11

Automated Parking is a low speed manoeuvring scenario which is quite unstructured and complex, requiring full 360 near-field sensing around the vehicle. In this paper, we discuss the design and implementation of an automated parking system from the perspective of camera based deep learning algorithms. We provide a holistic overview of an industrial system covering the embedded system, use cases and the deep learning architecture. We demonstrate a real-time multi-task deep learning network called FisheyeMultiNet, which detects all the necessary objects for parking on a low-power embedded system. FisheyeMultiNet runs at 15 fps for 4 cameras and it has three tasks namely object detection, semantic segmentation and soiling detection. To encourage further research, we release a partial dataset of 5,000 images containing semantic segmentation and bounding box detection ground truth via WoodScape project <cit.>.

READ FULL TEXT

page 1

page 5

research
01/12/2019

Real-time Joint Object Detection and Semantic Segmentation Network for Automated Driving

Convolutional Neural Networks (CNN) are successfully used for various vi...
research
01/19/2021

Multi-Task Network Pruning and Embedded Optimization for Real-time Deployment in ADAS

Camera-based Deep Learning algorithms are increasingly needed for percep...
research
07/01/2020

TiledSoilingNet: Tile-level Soiling Detection on Automotive Surround-view Cameras Using Coverage Metric

Automotive cameras, particularly surround-view cameras, tend to get soil...
research
01/19/2019

Design of Real-time Semantic Segmentation Decoder for Automated Driving

Semantic segmentation remains a computationally intensive algorithm for ...
research
01/07/2020

Trained Trajectory based Automated Parking System using Visual SLAM

Automated Parking is becoming a standard feature in modern vehicles. Exi...
research
01/20/2020

Real-Time Object Detection and Recognition on Low-Compute Humanoid Robots using Deep Learning

We envision that in the near future, humanoid robots would share home sp...
research
07/26/2023

Fluorescent Neuronal Cells v2: Multi-Task, Multi-Format Annotations for Deep Learning in Microscopy

Fluorescent Neuronal Cells v2 is a collection of fluorescence microscopy...

Please sign up or login with your details

Forgot password? Click here to reset