Convolutional Networks in Visual Environments

by   Alessandro Betti, et al.

The puzzle of computer vision might find new challenging solutions when we realize that most successful methods are working at image level, which is remarkably more difficult than processing directly visual streams. In this paper, we claim that their processing naturally leads to formulate the motion invariance principle, which enables the construction of a new theory of learning with convolutional networks. The theory addresses a number of intriguing questions that arise in natural vision, and offers a well-posed computational scheme for the discovery of convolutional filters over the retina. They are driven by differential equations derived from the principle of least cognitive action. Unlike traditional convolutional networks, which need massive supervision, the proposed theory offers a truly new scenario in which feature learning takes place by unsupervised processing of video signals. It is pointed out that an opportune blurring of the video, along the interleaving of segments of null signal, make it possible to conceive a novel learning mechanism that yields the minimum of the cognitive action. Basically, while the theory enables the implementation of novel computer vision systems, it is also provides an intriguing explanation of the solution that evolution has discovered for humans, where it looks like that the video blurring in newborns and the day-night rhythm seem to emerge in a general computational framework, regardless of biology.


page 1

page 2

page 3

page 4


Motion Invariance in Visual Environments

The puzzle of computer vision might find new challenging solutions when ...

Learning Visual Features Under Motion Invariance

Humans are continuously exposed to a stream of visual data with a natura...

Learning to see like children: proof of concept

In the last few years we have seen a growing interest in machine learnin...

Cognitive Action Laws: The Case of Visual Features

This paper proposes a theory for understanding perceptual learning proce...

Least Action Principles and Well-Posed Learning Problems

Machine Learning algorithms are typically regarded as appropriate optimi...

Towards Biologically Plausible Convolutional Networks

Convolutional networks are ubiquitous in deep learning. They are particu...

Please sign up or login with your details

Forgot password? Click here to reset