Multi-View Fusion and Distillation for Subgrade Distresses Detection based on 3D-GPR

08/09/2023
by   Chunpeng Zhou, et al.
0

The application of 3D ground-penetrating radar (3D-GPR) for subgrade distress detection has gained widespread popularity. To enhance the efficiency and accuracy of detection, pioneering studies have attempted to adopt automatic detection techniques, particularly deep learning. However, existing works typically rely on traditional 1D A-scan, 2D B-scan or 3D C-scan data of the GPR, resulting in either insufficient spatial information or high computational complexity. To address these challenges, we introduce a novel methodology for the subgrade distress detection task by leveraging the multi-view information from 3D-GPR data. Moreover, we construct a real multi-view image dataset derived from the original 3D-GPR data for the detection task, which provides richer spatial information compared to A-scan and B-scan data, while reducing computational complexity compared to C-scan data. Subsequently, we develop a novel Multi-View Vusion and Distillation framework, GPR-MVFD, specifically designed to optimally utilize the multi-view GPR dataset. This framework ingeniously incorporates multi-view distillation and attention-based fusion to facilitate significant feature extraction for subgrade distresses. In addition, a self-adaptive learning mechanism is adopted to stabilize the model training and prevent performance degeneration in each branch. Extensive experiments conducted on this new GPR benchmark demonstrate the effectiveness and efficiency of our proposed framework. Our framework outperforms not only the existing GPR baselines, but also the state-of-the-art methods in the fields of multi-view learning, multi-modal learning, and knowledge distillation. We will release the constructed multi-view GPR dataset with expert-annotated labels and the source codes of the proposed framework.

READ FULL TEXT

page 3

page 7

research
03/25/2023

Multi-view knowledge distillation transformer for human action recognition

Recently, Transformer-based methods have been utilized to improve the pe...
research
07/14/2023

MMSD2.0: Towards a Reliable Multi-modal Sarcasm Detection System

Multi-modal sarcasm detection has attracted much recent attention. Never...
research
10/15/2020

Multi-view Hierarchical Clustering

This paper focuses on the multi-view clustering, which aims to promote c...
research
12/21/2020

A Multi-View Dynamic Fusion Framework: How to Improve the Multimodal Brain Tumor Segmentation from Multi-Views?

When diagnosing the brain tumor, doctors usually make a diagnosis by obs...
research
12/15/2022

DETR4D: Direct Multi-View 3D Object Detection with Sparse Attention

3D object detection with surround-view images is an essential task for a...
research
03/28/2023

Enhancing Depth Completion with Multi-View Monitored Distillation

This paper presents a novel method for depth completion, which leverages...
research
03/09/2023

Dynamic Multi-View Fusion Mechanism For Chinese Relation Extraction

Recently, many studies incorporate external knowledge into character-lev...

Please sign up or login with your details

Forgot password? Click here to reset