Adaptive and Azimuth-Aware Fusion Network of Multimodal Local Features for 3D Object Detection

by   Yonglin Tian, et al.

This paper focuses on the construction of stronger local features and the effective fusion of image and LiDAR data. We adopt different modalities of LiDAR data to generate richer features and present an adaptive and azimuth-aware network to aggregate local features from image, bird's eye view maps and point cloud. Our network mainly consists of three subnetworks: ground plane estimation network, region proposal network and adaptive fusion network. The ground plane estimation network extracts features of point cloud and predicts the parameters of a plane which are used for generating abundant 3D anchors. The region proposal network generates features of image and bird's eye view maps to output region proposals. To integrate heterogeneous image and point cloud features, the adaptive fusion network explicitly adjusts the intensity of multiple local features and achieves the orientation consistency between image and LiDAR data by introduce an azimuth-aware fusion module. Experiments are conducted on KITTI dataset and the results validate the advantages of our aggregation of multimodal local features and the adaptive fusion network.


page 2

page 4

page 7

page 8

page 10


Multi-View 3D Object Detection Network for Autonomous Driving

This paper aims at high-accuracy 3D object detection in autonomous drivi...

R-AGNO-RPN: A LIDAR-Camera Region Deep Network for Resolution-Agnostic Detection

Current neural networks-based object detection approaches processing LiD...

On Enhancing Ground Surface Detection from Sparse Lidar Point Cloud

Ground surface detection in point cloud is widely used as a key module i...

MVX-Net: Multimodal VoxelNet for 3D Object Detection

Many recent works on 3D object detection have focused on designing neura...

BiFNet: Bidirectional Fusion Network for Road Segmentation

Multi-sensor fusion-based road segmentation plays an important role in t...

Ground Profile Recovery from Aerial 3D LiDAR-based Maps

The paper presents the study and implementation of the ground detection ...

CAP-Net: Correspondence-Aware Point-view Fusion Network for 3D Shape Analysis

Learning 3D representations by fusing point cloud and multi-view data ha...

Please sign up or login with your details

Forgot password? Click here to reset