Multi-View Ensemble Learning With Missing Data: Computational Framework and Evaluations using Novel Data from the Safe Autonomous Driving Domain

01/30/2023
by   Ross Greer, et al.
0

Real-world applications with multiple sensors observing an event are expected to make continuously-available predictions, even in cases where information may be intermittently missing. We explore methods in ensemble learning and sensor fusion to make use of redundancy and information shared between four camera views, applied to the task of hand activity classification for autonomous driving. In particular, we show that a late-fusion approach between parallel convolutional neural networks can outperform even the best-placed single camera model. To enable this approach, we propose a scheme for handling missing information, and then provide comparative analysis of this late-fusion approach to additional methods such as weighted majority voting and model combination schemes.

READ FULL TEXT

page 1

page 5

research
04/11/2023

Exploring and Exploiting Uncertainty for Incomplete Multi-View Classification

Classifying incomplete multi-view data is inevitable since arbitrary vie...
research
03/09/2023

RMMDet: Road-Side Multitype and Multigroup Sensor Detection System for Autonomous Driving

Autonomous driving has now made great strides thanks to artificial intel...
research
11/04/2021

When Neural Networks Using Different Sensors Create Similar Features

Multimodal problems are omnipresent in the real world: autonomous drivin...
research
01/14/2023

(Safe) SMART Hands: Hand Activity Analysis and Distraction Alerts Using a Multi-Camera Framework

Manual (hand-related) activity is a significant source of crash risk whi...
research
07/28/2022

Safety-Enhanced Autonomous Driving Using Interpretable Sensor Fusion Transformer

Large-scale deployment of autonomous vehicles has been continually delay...
research
11/06/2022

"Seeing Sound": Audio Classification with the Wigner-Wille Distribution and Convolutional Neural Networks

With big data becoming increasingly available, IoT hardware becoming wid...
research
02/22/2022

Enabling Efficient Deep Convolutional Neural Network-based Sensor Fusion for Autonomous Driving

Autonomous driving demands accurate perception and safe decision-making....

Please sign up or login with your details

Forgot password? Click here to reset