DeepAI AI Chat
Log In Sign Up

Multifaceted Analysis of Fine-Tuning in Deep Model for Visual Recognition

by   Xiangyang Li, et al.

In recent years, convolutional neural networks (CNNs) have achieved impressive performance for various visual recognition scenarios. CNNs trained on large labeled datasets can not only obtain significant performance on most challenging benchmarks but also provide powerful representations, which can be used to a wide range of other tasks. However, the requirement of massive amounts of data to train deep neural networks is a major drawback of these models, as the data available is usually limited or imbalanced. Fine-tuning (FT) is an effective way to transfer knowledge learned in a source dataset to a target task. In this paper, we introduce and systematically investigate several factors that influence the performance of fine-tuning for visual recognition. These factors include parameters for the retraining procedure (e.g., the initial learning rate of fine-tuning), the distribution of the source and target data (e.g., the number of categories in the source dataset, the distance between the source and target datasets) and so on. We quantitatively and qualitatively analyze these factors, evaluate their influence, and present many empirical observations. The results reveal insights into what fine-tuning changes CNN parameters and provide useful and evidence-backed intuitions about how to implement fine-tuning for computer vision tasks.


page 1

page 3

page 4

page 7

page 11

page 14

page 18

page 20


Memory Integrity of CNNs for Cross-Dataset Facial Expression Recognition

Facial expression recognition is a major problem in the domain of artifi...

VGG Fine-tuning for Cooking State Recognition

An important task that domestic robots need to achieve is the recognitio...

Supervised Fine-tuning Evaluation for Long-term Visual Place Recognition

In this paper, we present a comprehensive study on the utility of deep c...

3D Convolutional Neural Networks for Dendrite Segmentation Using Fine-Tuning and Hyperparameter Optimization

Dendritic microstructures are ubiquitous in nature and are the primary s...

Growing a Brain: Fine-Tuning by Increasing Model Capacity

CNNs have made an undeniable impact on computer vision through the abili...

Parameter Transfer Unit for Deep Neural Networks

Parameters in deep neural networks which are trained on large-scale data...

Factors of Transferability for a Generic ConvNet Representation

Evidence is mounting that Convolutional Networks (ConvNets) are the most...