Kaggle Kinship Recognition Challenge: Introduction of Convolution-Free Model to boost conventional

06/11/2022
by   Mingchuan Tian, et al.
0

This work aims to explore a convolution-free base classifier that can be used to widen the variations of the conventional ensemble classifier. Specifically, we propose Vision Transformers as base classifiers to combine with CNNs for a unique ensemble solution in Kaggle kinship recognition. In this paper, we verify our proposed idea by implementing and optimizing variants of the Vision Transformer model on top of the existing CNN models. The combined models achieve better scores than conventional ensemble classifiers based solely on CNN variants. We demonstrate that highly optimized CNN ensembles publicly available on the Kaggle Discussion board can easily achieve a significant boost in ROC score by simply ensemble with variants of the Vision Transformer model due to low correlation.

READ FULL TEXT

page 2

page 4

page 5

page 6

page 7

page 9

page 10

research
09/18/2020

Ensemble of Binary Classifiers Combined Using Recurrent Correlation Associative Memories

An ensemble method should cleverly combine a group of base classifiers t...
research
10/28/2021

Blending Anti-Aliasing into Vision Transformer

The transformer architectures, based on self-attention mechanism and con...
research
11/15/2017

Efficient Estimation of Generalization Error and Bias-Variance Components of Ensembles

For many applications, an ensemble of base classifiers is an effective s...
research
01/20/2022

TerViT: An Efficient Ternary Vision Transformer

Vision transformers (ViTs) have demonstrated great potential in various ...
research
05/30/2019

Deep ensemble learning for Alzheimers disease classification

Ensemble learning use multiple algorithms to obtain better predictive pe...
research
06/25/2022

SC-Transformer++: Structured Context Transformer for Generic Event Boundary Detection

This report presents the algorithm used in the submission of Generic Eve...
research
03/15/2023

Interpretable Ensembles of Hyper-Rectangles as Base Models

A new extremely simple ensemble-based model with the uniformly generated...

Please sign up or login with your details

Forgot password? Click here to reset