A Simple and Efficient Multi-task Network for 3D Object Detection and Road Understanding

03/06/2021
by   Di Feng, et al.
0

Detecting dynamic objects and predicting static road information such as drivable areas and ground heights are crucial for safe autonomous driving. Previous works studied each perception task separately, and lacked a collective quantitative analysis. In this work, we show that it is possible to perform all perception tasks via a simple and efficient multi-task network. Our proposed network, LidarMTL, takes raw LiDAR point cloud as inputs, and predicts six perception outputs for 3D object detection and road understanding. The network is based on an encoder-decoder architecture with 3D sparse convolution and deconvolution operations. Extensive experiments verify the proposed method with competitive accuracies compared to state-of-the-art object detectors and other task-specific networks. LidarMTL is also leveraged for online localization. Code and pre-trained model have been made available at https://github.com/frankfengdi/LidarMTL.

READ FULL TEXT

page 1

page 3

research
08/25/2021

YOLOP: You Only Look Once for Panoptic Driving Perception

A panoptic driving perception system is an essential part of autonomous ...
research
02/02/2023

AOP-Net: All-in-One Perception Network for Joint LiDAR-based 3D Object Detection and Panoptic Segmentation

LiDAR-based 3D object detection and panoptic segmentation are two crucia...
research
09/19/2022

LidarMultiNet: Towards a Unified Multi-task Network for LiDAR Perception

LiDAR-based 3D object detection, semantic segmentation, and panoptic seg...
research
08/24/2022

YOLOPv2: Better, Faster, Stronger for Panoptic Driving Perception

Over the last decade, multi-tasking learning approaches have achieved pr...
research
10/03/2022

CERBERUS: Simple and Effective All-In-One Automotive Perception Model with Multi Task Learning

Perceiving the surrounding environment is essential for enabling autonom...
research
10/10/2022

Edge Device Deployment of Multi-Tasking Network for Self-Driving Operations

A safe and robust autonomous driving system relies on accurate perceptio...
research
06/30/2018

Improved Techniques for Learning to Dehaze and Beyond: A Collective Study

This paper reviews the collective endeavors by the team of authors in ex...

Please sign up or login with your details

Forgot password? Click here to reset