DeepAI AI Chat
Log In Sign Up

Le Cam meets LeCun: Deficiency and Generic Feature Learning

by   Brendan van Rooyen, et al.
Australian National University

"Deep Learning" methods attempt to learn generic features in an unsupervised fashion from a large unlabelled data set. These generic features should perform as well as the best hand crafted features for any learning problem that makes use of this data. We provide a definition of generic features, characterize when it is possible to learn them and provide methods closely related to the autoencoder and deep belief network of deep learning. In order to do so we use the notion of deficiency and illustrate its value in studying certain general learning problems.


page 1

page 2

page 3

page 4


A Comparative Study of Computational Aesthetics

Objective metrics model image quality by quantifying image degradations ...

Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges

The last decade has witnessed an experimental revolution in data science...

A Theory of Feature Learning

Feature Learning aims to extract relevant information contained in data ...

Fusing Feature Engineering and Deep Learning: A Case Study for Malware Classification

Machine learning has become an appealing signature-less approach to dete...

Mosquito Detection with Neural Networks: The Buzz of Deep Learning

Many real-world time-series analysis problems are characterised by scarc...

CactusNets: Layer Applicability as a Metric for Transfer Learning

Deep neural networks trained over large datasets learn features that are...

Generic Programming with Combinators and Objects

We present a generic programming framework for OCAML which makes it poss...