Image Semantic Transformation: Faster, Lighter and Stronger

03/27/2018
by   Dasong Li, et al.
0

We propose Image-Semantic-Transformation-Reconstruction-Circle(ISTRC) model, a novel and powerful method using facenet's Euclidean latent space to understand the images. As the name suggests, ISTRC construct the circle, able to perfectly reconstruct images. One powerful Euclidean latent space embedded in ISTRC is FaceNet's last layer with the power of distinguishing and understanding images. Our model will reconstruct the images and manipulate Euclidean latent vectors to achieve semantic transformations and semantic images arthimetic calculations. In this paper, we show that ISTRC performs 10 high-level semantic transformations like "Male and female","add smile","open mouth", "deduct beard or add mustache", "bigger/smaller nose", "make older and younger", "bigger lips", "bigger eyes", "bigger/smaller mouths" and "more attractive". It just takes 3 hours(GTX 1080) to train the models of 10 semantic transformations.

READ FULL TEXT

page 3

page 5

page 6

page 8

page 9

page 10

page 13

page 14

research
12/05/2019

Representing Closed Transformation Paths in Encoded Network Latent Space

Deep generative networks have been widely used for learning mappings fro...
research
04/02/2019

A PCA-like Autoencoder

An autoencoder is a neural network which data projects to and from a low...
research
11/06/2017

Unsupervised Transformation Learning via Convex Relaxations

Our goal is to extract meaningful transformations from raw images, such ...
research
03/02/2019

Let's Transfer Transformations of Shared Semantic Representations

With a good image understanding capability, can we manipulate the images...
research
01/20/2018

Visual Data Augmentation through Learning

The rapid progress in machine learning methods has been empowered by i) ...
research
11/16/2016

Deep Feature Interpolation for Image Content Changes

We propose Deep Feature Interpolation (DFI), a new data-driven baseline ...
research
07/20/2021

Semantic Reasoning with Differentiable Graph Transformations

This paper introduces a differentiable semantic reasoner, where rules ar...

Please sign up or login with your details

Forgot password? Click here to reset