Real-time Full-stack Traffic Scene Perception for Autonomous Driving with Roadside Cameras

06/20/2022
by   Zhengxia Zou, et al.
0

We propose a novel and pragmatic framework for traffic scene perception with roadside cameras. The proposed framework covers a full-stack of roadside perception pipeline for infrastructure-assisted autonomous driving, including object detection, object localization, object tracking, and multi-camera information fusion. Unlike previous vision-based perception frameworks rely upon depth offset or 3D annotation at training, we adopt a modular decoupling design and introduce a landmark-based 3D localization method, where the detection and localization can be well decoupled so that the model can be easily trained based on only 2D annotations. The proposed framework applies to either optical or thermal cameras with pinhole or fish-eye lenses. Our framework is deployed at a two-lane roundabout located at Ellsworth Rd. and State St., Ann Arbor, MI, USA, providing 7x24 real-time traffic flow monitoring and high-precision vehicle trajectory extraction. The whole system runs efficiently on a low-power edge computing device with all-component end-to-end delay of less than 20ms.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

research
08/25/2021

YOLOP: You Only Look Once for Panoptic Driving Perception

A panoptic driving perception system is an essential part of autonomous ...
research
07/30/2021

Real-time Streaming Perception System for Autonomous Driving

Nowadays, plenty of deep learning technologies are being applied to all ...
research
11/08/2022

Estimation of Appearance and Occupancy Information in Birds Eye View from Surround Monocular Images

Autonomous driving requires efficient reasoning about the location and a...
research
02/06/2019

Real-time 3D Traffic Cone Detection for Autonomous Driving

Considerable progress has been made in semantic scene understanding of r...
research
09/17/2018

Real-Time Dense Mapping for Self-driving Vehicles using Fisheye Cameras

We present a real-time dense geometric mapping algorithm for large-scale...
research
05/18/2018

Scene Understanding Networks for Autonomous Driving based on Around View Monitoring System

Modern driver assistance systems rely on a wide range of sensors (RADAR,...
research
07/20/2023

Improving Online Lane Graph Extraction by Object-Lane Clustering

Autonomous driving requires accurate local scene understanding informati...

Please sign up or login with your details

Forgot password? Click here to reset