DeepAI AI Chat
Log In Sign Up

Le Cam meets LeCun: Deficiency and Generic Feature Learning

02/20/2014
by   Brendan van Rooyen, et al.
Australian National University
0

"Deep Learning" methods attempt to learn generic features in an unsupervised fashion from a large unlabelled data set. These generic features should perform as well as the best hand crafted features for any learning problem that makes use of this data. We provide a definition of generic features, characterize when it is possible to learn them and provide methods closely related to the autoencoder and deep belief network of deep learning. In order to do so we use the notion of deficiency and illustrate its value in studying certain general learning problems.

READ FULL TEXT

page 1

page 2

page 3

page 4

11/19/2018

A Comparative Study of Computational Aesthetics

Objective metrics model image quality by quantifying image degradations ...
04/27/2021

Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges

The last decade has witnessed an experimental revolution in data science...
04/01/2015

A Theory of Feature Learning

Feature Learning aims to extract relevant information contained in data ...
06/12/2022

Fusing Feature Engineering and Deep Learning: A Case Study for Malware Classification

Machine learning has become an appealing signature-less approach to dete...
05/15/2017

Mosquito Detection with Neural Networks: The Buzz of Deep Learning

Many real-world time-series analysis problems are characterised by scarc...
04/20/2018

CactusNets: Layer Applicability as a Metric for Transfer Learning

Deep neural networks trained over large datasets learn features that are...
06/02/2021

Generic Programming with Combinators and Objects

We present a generic programming framework for OCAML which makes it poss...