PAC-Bayesian Majority Vote for Late Classifier Fusion

07/04/2012
by   Emilie Morvant, et al.
0

A lot of attention has been devoted to multimedia indexing over the past few years. In the literature, we often consider two kinds of fusion schemes: The early fusion and the late fusion. In this paper we focus on late classifier fusion, where one combines the scores of each modality at the decision level. To tackle this problem, we investigate a recent and elegant well-founded quadratic program named MinCq coming from the Machine Learning PAC-Bayes theory. MinCq looks for the weighted combination, over a set of real-valued functions seen as voters, leading to the lowest misclassification rate, while making use of the voters' diversity. We provide evidence that this method is naturally adapted to late fusion procedure. We propose an extension of MinCq by adding an order- preserving pairwise loss for ranking, helping to improve Mean Averaged Precision measure. We confirm the good behavior of the MinCq-based fusion approaches with experiments on a real image benchmark.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/30/2014

Majority Vote of Diverse Classifiers for Late Fusion

In the past few years, a lot of attention has been devoted to multimedia...
research
06/12/2008

Fusion de classifieurs pour la classification d'images sonar

In this paper, we present some high level information fusion approaches ...
research
06/23/2016

PAC-Bayesian Analysis for a two-step Hierarchical Multiview Learning Approach

We study a two-level multiview learning with more than two views under t...
research
08/08/2020

Recent Advances and New Guidelines on Hyperspectral and Multispectral Image Fusion

Hyperspectral image (HSI) with high spectral resolution often suffers fr...
research
10/22/2021

Conditional Gaussian PAC-Bayes

Recent studies have empirically investigated different methods to train ...
research
07/16/2012

Fusing image representations for classification using support vector machines

In order to improve classification accuracy different image representati...
research
01/13/2020

Multi-Sensor Data and Knowledge Fusion – A Proposal for a Terminology Definition

Fusion is a common tool for the analysis and utilization of available da...

Please sign up or login with your details

Forgot password? Click here to reset