Impact of ImageNet Model Selection on Domain Adaptation

02/06/2020
by   Youshan Zhang, et al.
0

Deep neural networks are widely used in image classification problems. However, little work addresses how features from different deep neural networks affect the domain adaptation problem. Existing methods often extract deep features from one ImageNet model, without exploring other neural networks. In this paper, we investigate how different ImageNet models affect transfer accuracy on domain adaptation problems. We extract features from sixteen distinct pre-trained ImageNet models and examine the performance of twelve benchmarking methods when using the features. Extensive experimental results show that a higher accuracy ImageNet model produces better features, and leads to higher accuracy on domain adaptation problems (with a correlation coefficient of up to 0.95). We also examine the architecture of each neural network to find the best layer for feature extraction. Together, performance from our features exceeds that of the state-of-the-art in three benchmark datasets.

READ FULL TEXT
research
04/04/2019

Modified Distribution Alignment for Domain Adaptation with Pre-trainedInception ResNet

Deep neural networks have been widely used in computer vision. There are...
research
12/07/2015

Scalable domain adaptation of convolutional neural networks

Convolutional neural networks (CNNs) tend to become a standard approach ...
research
07/27/2021

A Low-Cost Neural ODE with Depthwise Separable Convolution for Edge Domain Adaptation on FPGAs

Although high-performance deep neural networks are in high demand in edg...
research
06/24/2020

Time for a Background Check! Uncovering the impact of Background Features on Deep Neural Networks

With increasing expressive power, deep neural networks have significantl...
research
04/27/2021

Adapting ImageNet-scale models to complex distribution shifts with self-learning

While self-learning methods are an important component in many recent do...
research
11/21/2017

Residual Parameter Transfer for Deep Domain Adaptation

The goal of Deep Domain Adaptation is to make it possible to use Deep Ne...
research
04/27/2021

Efficient Pre-trained Features and Recurrent Pseudo-Labeling inUnsupervised Domain Adaptation

Domain adaptation (DA) mitigates the domain shift problem when transferr...

Please sign up or login with your details

Forgot password? Click here to reset