Onboard dynamic-object detection and tracking for autonomous robot navigation with RGB-D camera

02/28/2023
by   Zhefan Xu, et al.
0

Deploying autonomous robots in crowded indoor environments usually requires them to have accurate dynamic obstacle perception. Although plenty of previous works in the autonomous driving field have investigated the 3D object detection problem, the usage of dense point clouds from a heavy LiDAR and their high computation cost for learning-based data processing make those methods not applicable to lightweight robots, such as vision-based UAVs with small onboard computers. To address this issue, we propose a lightweight 3D dynamic obstacle detection and tracking (DODT) method based on an RGB-D camera. Our method adopts a novel ensemble detection strategy, combining multiple computationally efficient but low-accuracy detectors to achieve real-time high-accuracy obstacle detection. Besides, we introduce a new feature-based data association method to prevent mismatches and use the Kalman filter with the constant acceleration model to track detected obstacles. In addition, our system includes an optional and auxiliary learning-based module to enhance the obstacle detection range and dynamic obstacle identification. The users can determine whether or not to run this module based on the available computation resources. The proposed method is implemented in a lightweight quadcopter, and the experiments prove that the algorithm can make the robot detect dynamic obstacles and navigate dynamic environments safely.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

page 7

page 8

research
09/17/2022

A real-time dynamic obstacle tracking and mapping system for UAV navigation and collision avoidance with an RGB-D camera

The real-time dynamic environment perception has become vital for autono...
research
04/29/2022

Using 3D Shadows to Detect Object Hiding Attacks on Autonomous Vehicle Perception

Autonomous Vehicles (AVs) are mostly reliant on LiDAR sensors which enab...
research
09/28/2018

Real-time Dynamic Object Detection for Autonomous Driving using Prior 3D-Maps

Lidar has become an essential sensor for autonomous driving as it provid...
research
07/28/2023

Local and Global Information in Obstacle Detection on Railway Tracks

Reliable obstacle detection on railways could help prevent collisions th...
research
09/04/2018

Developing a Purely Visual Based Obstacle Detection using Inverse Perspective Mapping

Our solution is implemented in and for the frame of Duckietown. The goal...
research
06/29/2023

MotionTrack: End-to-End Transformer-based Multi-Object Tracing with LiDAR-Camera Fusion

Multiple Object Tracking (MOT) is crucial to autonomous vehicle percepti...
research
06/25/2017

Obstacle detection test in real-word traffic contexts for the purposes of motorcycle autonomous emergency braking (MAEB)

Research suggests that a Motorcycle Autonomous Emergency Braking system ...

Please sign up or login with your details

Forgot password? Click here to reset