MAFF-Net: Filter False Positive for 3D Vehicle Detection with Multi-modal Adaptive Feature Fusion

by   Zehan Zhang, et al.

3D vehicle detection based on multi-modal fusion is an important task of many applications such as autonomous driving. Although significant progress has been made, we still observe two aspects that need to be further improvement: First, the specific gain that camera images can bring to 3D detection is seldom explored by previous works. Second, many fusion algorithms run slowly, which is essential for applications with high real-time requirements(autonomous driving). To this end, we propose an end-to-end trainable single-stage multi-modal feature adaptive network in this paper, which uses image information to effectively reduce false positive of 3D detection and has a fast detection speed. A multi-modal adaptive feature fusion module based on channel attention mechanism is proposed to enable the network to adaptively use the feature of each modal. Based on the above mechanism, two fusion technologies are proposed to adapt to different usage scenarios: PointAttentionFusion is suitable for filtering simple false positive and faster; DenseAttentionFusion is suitable for filtering more difficult false positive and has better overall performance. Experimental results on the KITTI dataset demonstrate significant improvement in filtering false positive over the approach using only point cloud data. Furthermore, the proposed method can provide competitive results and has the fastest speed compared to the published state-of-the-art multi-modal methods in the KITTI benchmark.


page 1

page 7


Multi-modal Fusion Technology based on Vehicle Information: A Survey

Multi-modal fusion is a basic task of autonomous driving system percepti...

3D Multi-Object Tracking Using Graph Neural Networks with Cross-Edge Modality Attention

Online 3D multi-object tracking (MOT) has witnessed significant research...

Multi-modal Identification of State-Sponsored Propaganda on Social Media

The prevalence of state-sponsored propaganda on the Internet has become ...

Stacked Hourglass Network with a Multi-level Attention Mechanism: Where to Look for Intervertebral Disc Labeling

Labeling vertebral discs from MRI scans is important for the proper diag...

False Positive Removal for 3D Vehicle Detection with Penetrated Point Classifier

Recently, researchers have been leveraging LiDAR point cloud for higher ...

End-to-end Deep Learning from Raw Sensor Data: Atrial Fibrillation Detection using Wearables

We present a convolutional-recurrent neural network architecture with lo...

Road Detection Technique Using Filters with Application to Autonomous Driving System

Autonomous driving systems are broadly used equipment in the industries ...

Please sign up or login with your details

Forgot password? Click here to reset