Neural Architecture Search From Task Similarity Measure

02/27/2021
by   Cat P. Le, et al.
0

In this paper, we propose a neural architecture search framework based on a similarity measure between various tasks defined in terms of Fisher information. By utilizing the relation between a target and a set of existing tasks, the search space of architectures can be significantly reduced, making the discovery of the best candidates in the set of possible architectures tractable. This method eliminates the requirement for training the networks from scratch for the target task. Simulation results illustrate the efficacy of our proposed approach and its competitiveness with state-of-the-art methods.

READ FULL TEXT
research
03/23/2021

Neural Architecture Search From Fréchet Task Distance

We formulate a Fréchet-type asymmetric distance between tasks based on F...
research
10/27/2020

Task-Aware Neural Architecture Search

The design of handcrafted neural networks requires a lot of time and res...
research
12/27/2018

Neural Architecture Search Over a Graph Search Space

Neural architecture search (NAS) enabled the discovery of state-of-the-a...
research
09/15/2021

RankNAS: Efficient Neural Architecture Search by Pairwise Ranking

This paper addresses the efficiency challenge of Neural Architecture Sea...
research
10/23/2019

Efficient Decoupled Neural Architecture Search by Structure and Operation Sampling

We propose a novel neural architecture search algorithm via reinforcemen...
research
03/26/2021

Visionary: Vision architecture discovery for robot learning

We propose a vision-based architecture search algorithm for robot manipu...
research
11/08/2021

An Approach for Combining Multimodal Fusion and Neural Architecture Search Applied to Knowledge Tracing

Knowledge Tracing is the process of tracking mastery level of different ...

Please sign up or login with your details

Forgot password? Click here to reset