Majority Vote of Diverse Classifiers for Late Fusion

04/30/2014
by   Emilie Morvant, et al.
0

In the past few years, a lot of attention has been devoted to multimedia indexing by fusing multimodal informations. Two kinds of fusion schemes are generally considered: The early fusion and the late fusion. We focus on late classifier fusion, where one combines the scores of each modality at the decision level. To tackle this problem, we investigate a recent and elegant well-founded quadratic program named MinCq coming from the machine learning PAC-Bayesian theory. MinCq looks for the weighted combination, over a set of real-valued functions seen as voters, leading to the lowest misclassification rate, while maximizing the voters' diversity. We propose an extension of MinCq tailored to multimedia indexing. Our method is based on an order-preserving pairwise loss adapted to ranking that allows us to improve Mean Averaged Precision measure while taking into account the diversity of the voters that we want to fuse. We provide evidence that this method is naturally adapted to late fusion procedures and confirm the good behavior of our approach on the challenging PASCAL VOC'07 benchmark.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/04/2012

PAC-Bayesian Majority Vote for Late Classifier Fusion

A lot of attention has been devoted to multimedia indexing over the past...
research
06/23/2016

PAC-Bayesian Analysis for a two-step Hierarchical Multiview Learning Approach

We study a two-level multiview learning with more than two views under t...
research
09/23/2018

Understanding the Gist of Images - Ranking of Concepts for Multimedia Indexing

Nowadays, where multimedia data is continuously generated, stored, and d...
research
09/01/2022

Progressive Fusion for Multimodal Integration

Integration of multimodal information from various sources has been show...
research
12/17/2016

A Fusion Method Based on Decision Reliability Ratio for Finger Vein Verification

Finger vein verification has developed a lot since its first proposal, b...
research
02/23/2022

Fusion of Probability Density Functions

Fusing probabilistic information is a fundamental task in signal and dat...
research
07/11/2022

A Late Fusion Framework with Multiple Optimization Methods for Media Interestingness

The recent advancement in Multimedia Analytical, Computer Vision (CV), a...

Please sign up or login with your details

Forgot password? Click here to reset