Accelerating Machine Learning via the Weber-Fechner Law

04/21/2022
by   B. N. Kausik, et al.
0

The Weber-Fechner Law observes that human perception scales as the logarithm of the stimulus. We argue that learning algorithms for human concepts could benefit from the Weber-Fechner Law. Specifically, we impose Weber-Fechner on simple neural networks, with or without convolution, via the logarithmic power series of their sorted output. Our experiments show surprising performance and accuracy on the MNIST data set within a few training iterations and limited computational resources, suggesting that Weber-Fechner can accelerate machine learning of human concepts.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/23/2022

Psychophysical Machine Learning

The Weber Fechner Law of psychophysics observes that human perception is...
research
06/16/2023

Power-law Dynamic arising from machine learning

We study a kind of new SDE that was arisen from the research on optimiza...
research
01/09/2019

Three Other Models of Computer System Performance

This note argues for more use of simple models beyond Amdahl's Law: Bott...
research
04/15/2022

The training response law explains how deep neural networks learn

Deep neural network is the widely applied technology in this decade. In ...
research
11/10/2022

Reinforcement Learning in an Adaptable Chess Environment for Detecting Human-understandable Concepts

Self-trained autonomous agents developed using machine learning are show...
research
04/11/2019

Connections Between Adaptive Control and Optimization in Machine Learning

This paper demonstrates many immediate connections between adaptive cont...
research
05/09/2020

AGI and the Knight-Darwin Law: why idealized AGI reproduction requires collaboration

Can an AGI create a more intelligent AGI? Under idealized assumptions, f...

Please sign up or login with your details

Forgot password? Click here to reset