Mass Personalization of Deep Learning

09/06/2019
by   Johannes Schneider, et al.
0

We discuss training techniques, objectives and metrics toward mass personalization of deep learning models. In machine learning, personalization refers to the fact that every trained model should be targeted towards an individual by optimizing one or several performance metrics and often obeying additional constraints. We investigate three methods for personalized training of neural networks. They constitute three forms of curriculum learning. The methods are partially inspired by the "shaping" concept from psychology. Interestingly, we discover that extensive exposure to a limited set of training data in terms of class diversity early in the training can lead to an irreversible reduction of the capability of a network to learn from more diverse training data. This is in close alignment with existing theories in human development. In contrast, training on a small data set covering all classes early in the training can lead to better performance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/03/2018

ScreenerNet: Learning Curriculum for Neural Networks

We propose to learn a curriculum or a syllabus for supervised learning w...
research
12/14/2017

MentorNet: Regularizing Very Deep Neural Networks on Corrupted Labels

Recent studies have discovered that deep networks are capable of memoriz...
research
01/15/2019

Comparing two deep learning sequence-based models for protein-protein interaction prediction

Biological data are extremely diverse, complex but also quite sparse. Th...
research
02/02/2020

Interpretability of Blackbox Machine Learning Models through Dataview Extraction and Shadow Model creation

Deep learning models trained using massive amounts of data tend to captu...
research
07/21/2023

Beyond Convergence: Identifiability of Machine Learning and Deep Learning Models

Machine learning (ML) and deep learning models are extensively used for ...
research
04/26/2021

Balancing Constraints and Submodularity in Data Subset Selection

Deep learning has yielded extraordinary results in vision and natural la...
research
12/02/2021

Training Efficiency and Robustness in Deep Learning

Deep Learning has revolutionized machine learning and artificial intelli...

Please sign up or login with your details

Forgot password? Click here to reset