CNNs with Multi-Level Attention for Domain Generalization

04/02/2023
by   Aristotelis Ballas, et al.
0

In the past decade, deep convolutional neural networks have achieved significant success in image classification and ranking and have therefore found numerous applications in multimedia content retrieval. Still, these models suffer from performance degradation when neural networks are tested on out-of-distribution scenarios or on data originating from previously unseen data Domains. In the present work, we focus on this problem of Domain Generalization and propose an alternative neural network architecture for robust, out-of-distribution image classification. We attempt to produce a model that focuses on the causal features of the depicted class for robust image classification in the Domain Generalization setting. To achieve this, we propose attending to multiple-levels of information throughout a Convolutional Neural Network and leveraging the most important attributes of an image by employing trainable attention mechanisms. To validate our method, we evaluate our model on four widely accepted Domain Generalization benchmarks, on which our model is able to surpass previously reported baselines in three out of four datasets and achieve the second best score in the fourth one.

READ FULL TEXT
research
05/26/2023

CNN Feature Map Augmentation for Single-Source Domain Generalization

In search of robust and generalizable machine learning models, Domain Ge...
research
08/28/2023

Multi-Scale and Multi-Layer Contrastive Learning for Domain Generalization

During the past decade, deep neural networks have led to fast-paced prog...
research
02/05/2023

Achieving Robust Generalization for Wireless Channel Estimation Neural Networks by Designed Training Data

In this paper, we propose a method to design the training data that can ...
research
09/14/2021

A trainable monogenic ConvNet layer robust in front of large contrast changes in image classification

Convolutional Neural Networks (ConvNets) at present achieve remarkable p...
research
02/25/2021

Robust Pollen Imagery Classification with Generative Modeling and Mixup Training

Deep learning approaches have shown great success in image classificatio...
research
07/27/2022

Multi-layer Representation Learning for Robust OOD Image Classification

Convolutional Neural Networks have become the norm in image classificati...
research
08/20/2022

A Domain Generalization Approach for Out-Of-Distribution 12-lead ECG Classification with Convolutional Neural Networks

Deep Learning systems have achieved great success in the past few years,...

Please sign up or login with your details

Forgot password? Click here to reset