RadarFormer: Lightweight and Accurate Real-Time Radar Object Detection Model

04/17/2023
by   Yahia Dalbah, et al.
0

The performance of perception systems developed for autonomous driving vehicles has seen significant improvements over the last few years. This improvement was associated with the increasing use of LiDAR sensors and point cloud data to facilitate the task of object detection and recognition in autonomous driving. However, LiDAR and camera systems show deteriorating performances when used in unfavorable conditions like dusty and rainy weather. Radars on the other hand operate on relatively longer wavelengths which allows for much more robust measurements in these conditions. Despite that, radar-centric data sets do not get a lot of attention in the development of deep learning techniques for radar perception. In this work, we consider the radar object detection problem, in which the radar frequency data is the only input into the detection framework. We further investigate the challenges of using radar-only data in deep learning models. We propose a transformers-based model, named RadarFormer, that utilizes state-of-the-art developments in vision deep learning. Our model also introduces a channel-chirp-time merging module that reduces the size and complexity of our models by more than 10 times without compromising accuracy. Comprehensive experiments on the CRUW radar dataset demonstrate the advantages of the proposed method. Our RadarFormer performs favorably against the state-of-the-art methods while being 2x faster during inference and requiring only one-tenth of their model parameters. The code associated with this paper is available at https://github.com/YahiDar/RadarFormer.

READ FULL TEXT

page 2

page 13

research
02/27/2020

Deep Learning on Radar Centric 3D Object Detection

Even though many existing 3D object detection algorithms rely mostly on ...
research
06/16/2022

K-Radar: 4D Radar Object Detection Dataset and Benchmark for Autonomous Driving in Various Weather Conditions

Unlike RGB cameras that use visible light bands (384∼769 THz) and Lidar ...
research
06/15/2023

Radars for Autonomous Driving: A Review of Deep Learning Methods and Challenges

Radar is a key component of the suite of perception sensors used for saf...
research
07/17/2023

ROFusion: Efficient Object Detection using Hybrid Point-wise Radar-Optical Fusion

Radars, due to their robustness to adverse weather conditions and abilit...
research
03/04/2021

PolarNet: Accelerated Deep Open Space Segmentation Using Automotive Radar in Polar Domain

Camera and Lidar processing have been revolutionized with the rapid deve...
research
03/14/2021

Radar Camera Fusion via Representation Learning in Autonomous Driving

Radars and cameras are mature, cost-effective, and robust sensors and ha...
research
03/29/2023

T-FFTRadNet: Object Detection with Swin Vision Transformers from Raw ADC Radar Signals

Object detection utilizing Frequency Modulated Continous Wave radar is b...

Please sign up or login with your details

Forgot password? Click here to reset