Neural Embedding for Physical Manipulations

07/13/2019
by   Lingzhi Zhang, et al.
2

In common real-world robotic operations, action and state spaces can be vast and sometimes unknown, and observations are often relatively sparse. How do we learn the full topology of action and state spaces when given only few and sparse observations? Inspired by the properties of grid cells in mammalian brains, we build a generative model that enforces a normalized pairwise distance constraint between the latent space and output space to achieve data-efficient discovery of output spaces. This method achieves substantially better results than prior generative models, such as Generative Adversarial Networks (GANs) and Variational Auto-Encoders (VAEs). Prior models have the common issue of mode collapse and thus fail to explore the full topology of output space. We demonstrate the effectiveness of our model on various datasets both qualitatively and quantitatively.

READ FULL TEXT

page 6

page 7

page 8

research
11/06/2017

Optimal transport maps for distribution preserving operations on latent spaces of Generative Models

Generative models such as Variational Auto Encoders (VAEs) and Generativ...
research
12/21/2020

AVAE: Adversarial Variational Auto Encoder

Among the wide variety of image generative models, two models stand out:...
research
04/07/2019

Normalized Diversification

Generating diverse yet specific data is the goal of the generative adver...
research
08/22/2018

Escaping from Collapsing Modes in a Constrained Space

Generative adversarial networks (GANs) often suffer from unpredictable m...
research
02/05/2018

Task-Aware Compressed Sensing with Generative Adversarial Networks

In recent years, neural network approaches have been widely adopted for ...
research
10/25/2021

Variational framework for partially-measured physical system control: examples of vision neuroscience and optical random media

To characterize a physical system to behave as desired, either its under...

Please sign up or login with your details

Forgot password? Click here to reset