Bag of Tricks for Out-of-Distribution Generalization

08/23/2022
by   Zining Chen, et al.
0

Recently, out-of-distribution (OOD) generalization has attracted attention to the robustness and generalization ability of deep learning based models, and accordingly, many strategies have been made to address different aspects related to this issue. However, most existing algorithms for OOD generalization are complicated and specifically designed for certain dataset. To alleviate this problem, nicochallenge-2022 provides NICO++, a large-scale dataset with diverse context information. In this paper, based on systematic analysis of different schemes on NICO++ dataset, we propose a simple but effective learning framework via coupling bag of tricks, including multi-objective framework design, data augmentations, training and inference strategies. Our algorithm is memory-efficient and easily-equipped, without complicated modules and does not require for large pre-trained models. It achieves an excellent performance with Top-1 accuracy of 88.16 ranks 1st in domain generalization task of nicochallenge-2022.

READ FULL TEXT

page 4

page 6

research
02/03/2023

Gradient Estimation for Unseen Domain Risk Minimization with Pre-Trained Models

Domain generalization aims to build generalized models that perform well...
research
09/18/2022

Bootstrap Generalization Ability from Loss Landscape Perspective

Domain generalization aims to learn a model that can generalize well on ...
research
01/16/2021

Robustness to Augmentations as a Generalization metric

Generalization is the ability of a model to predict on unseen domains an...
research
04/19/2023

AdapterGNN: Efficient Delta Tuning Improves Generalization Ability in Graph Neural Networks

Fine-tuning pre-trained models has recently yielded remarkable performan...
research
10/21/2021

Ensemble of Averages: Improving Model Selection and Boosting Performance in Domain Generalization

In Domain Generalization (DG) settings, models trained on a given set of...
research
12/15/2021

Detail-aware Deep Clothing Animations Infused with Multi-source Attributes

This paper presents a novel learning-based clothing deformation method t...
research
07/09/2023

CA-CentripetalNet: A novel anchor-free deep learning framework for hardhat wearing detection

Automatic hardhat wearing detection can strengthen the safety management...

Please sign up or login with your details

Forgot password? Click here to reset