A Robust Real-Time Computing-based Environment Sensing System for Intelligent Vehicle

01/27/2020
by   Qiwei Xie, et al.
29

For intelligent vehicles, sensing the 3D environment is the first but crucial step. In this paper, we build a real-time advanced driver assistance system based on a low-power mobile platform. The system is a real-time multi-scheme integrated innovation system, which combines stereo matching algorithm with machine learning based obstacle detection approach and takes advantage of the distributed computing technology of a mobile platform with GPU and CPUs. First of all, a multi-scale fast MPV (Multi-Path-Viterbi) stereo matching algorithm is proposed, which can generate robust and accurate disparity map. Then a machine learning, which is based on fusion technology of monocular and binocular, is applied to detect the obstacles. We also advance an automatic fast calibration mechanism based on Zhang's calibration method. Finally, the distributed computing and reasonable data flow programming are applied to ensure the operational efficiency of the system. The experimental results show that the system can achieve robust and accurate real-time environment perception for intelligent vehicles, which can be directly used in the commercial real-time intelligent driving applications.

READ FULL TEXT

page 5

page 9

page 19

page 21

page 23

page 27

page 28

page 29

research
10/13/2016

Embedded real-time stereo estimation via Semi-Global Matching on the GPU

Dense, robust and real-time computation of depth information from stereo...
research
07/05/2018

Real-Time Subpixel Fast Bilateral Stereo

Stereo vision technique has been widely used in robotic systems to acqui...
research
12/01/2020

Robust and Accurate Object Velocity Detection by Stereo Camera for Autonomous Driving

Although the number of camera-based sensors mounted on vehicles has rece...
research
07/24/2023

MFMAN-YOLO: A Method for Detecting Pole-like Obstacles in Complex Environment

In real-world traffic, there are various uncertainties and complexities ...
research
03/29/2023

An intelligent modular real-time vision-based system for environment perception

A significant portion of driving hazards is caused by human error and di...
research
02/10/2018

Vehicle Three-Dimensional Pose and Shape Estimation from Multiple Monocular Vision

This paper proposes an accurate approach to estimate vehicles' 3D pose a...
research
02/01/2023

Laser Ranging Based Intelligent System for Unknown Environment Mapping

This work describes the implementation of a simple and computationally e...

Please sign up or login with your details

Forgot password? Click here to reset