On transfer learning using a MAC model variant

11/15/2018
by   Vincent Marois, et al.
0

We introduce a variant of the MAC model (Hudson and Manning, CVPR 2018) with a simplified set of equations that achieves comparable accuracy, while training faster. We evaluate both models on CLEVR and CoGenT, and show that, transfer learning with fine-tuning results in a 15 point increase in accuracy, matching the state of the art. Finally, in contrast, we demonstrate that improper fine-tuning can actually reduce a model's accuracy as well.

READ FULL TEXT
research
01/21/2020

Transfer Learning using Neural Ordinary Differential Equations

A concept of using Neural Ordinary Differential Equations(NODE) for Tran...
research
09/16/2022

Fine-tuning or top-tuning? Transfer learning with pretrained features and fast kernel methods

The impressive performances of deep learning architectures is associated...
research
04/15/2020

Transfer-Learning-Aware Neuro-Evolution for Diseases Detection in Chest X-Ray Images

The neural network needs excessive costs of time because of the complexi...
research
01/16/2023

Multimodal Side-Tuning for Document Classification

In this paper, we propose to exploit the side-tuning framework for multi...
research
02/06/2019

Fooling Neural Network Interpretations via Adversarial Model Manipulation

We ask whether the neural network interpretation methods can be fooled v...
research
02/23/2019

Transfer Learning for Non-Intrusive Load Monitoring

Non-intrusive load monitoring (NILM) is a technique to recover source ap...
research
04/19/2019

An Evaluation of Transfer Learning for Classifying Sales Engagement Emails at Large Scale

This paper conducts an empirical investigation to evaluate transfer lear...

Please sign up or login with your details

Forgot password? Click here to reset