research
∙
05/26/2023
Meta-prediction Model for Distillation-Aware NAS on Unseen Datasets
Distillation-aware Neural Architecture Search (DaNAS) aims to search for...
share
research
∙
05/26/2023
DiffusionNAG: Task-guided Neural Architecture Generation with Diffusion Models
Neural Architecture Search (NAS) has emerged as a powerful technique for...
research
∙
05/26/2023
A Study on Knowledge Distillation from Weak Teacher for Scaling Up Pre-trained Language Models
Distillation from Weak Teacher (DWT) is a method of transferring knowled...
research
∙
04/08/2022
SuperNet in Neural Architecture Search: A Taxonomic Survey
Deep Neural Networks (DNN) have made significant progress in a wide rang...
research
∙
10/06/2021
Online Hyperparameter Meta-Learning with Hypergradient Distillation
Many gradient-based meta-learning methods assume a set of parameters tha...
research
∙
07/02/2021
Rapid Neural Architecture Search by Learning to Generate Graphs from Datasets
Despite the success of recent Neural Architecture Search (NAS) methods o...
research
∙
06/16/2021
HELP: Hardware-Adaptive Efficient Latency Predictor for NAS via Meta-Learning
For deployment, neural architecture search should be hardware-aware, in ...
research
∙
03/02/2021
Task-Adaptive Neural Network Retrieval with Meta-Contrastive Learning
Most conventional Neural Architecture Search (NAS) approaches are limite...
research
∙
08/05/2019