Generative Hierarchical Features from Synthesizing Images

07/20/2020
by   Yinghao Xu, et al.
28

Generative Adversarial Networks (GANs) have recently advanced image synthesis by learning the underlying distribution of observed data in an unsupervised manner. However, how the features trained from solving the task of image synthesis are applicable to visual tasks remains seldom explored. In this work, we show that learning to synthesize images is able to bring remarkable hierarchical visual features that are generalizable across a wide range of visual tasks. Specifically, we consider the pre-trained StyleGAN generator as a learned loss function and utilize its layer-wise disentangled representation to train a novel hierarchical encoder. As a result, the visual feature produced by our encoder, termed as Generative Hierarchical Feature (GH-Feat), has compelling discriminative and disentangled properties, facilitating a range of both discriminative and generative tasks. Extensive experiments on face verification, landmark detection, layout prediction, transfer learning, style mixing, and image editing show the appealing performance of the GH-Feat learned from synthesizing images, outperforming existing unsupervised feature learning methods.

READ FULL TEXT

page 6

page 7

page 8

page 13

page 14

page 15

research
01/12/2023

GH-Feat: Learning Versatile Generative Hierarchical Features from GANs

Recent years witness the tremendous success of generative adversarial ne...
research
02/12/2018

Synthesizing Audio with Generative Adversarial Networks

While Generative Adversarial Networks (GANs) have seen wide success at t...
research
05/18/2021

Decorating Your Own Bedroom: Locally Controlling Image Generation with Generative Adversarial Networks

Generative Adversarial Networks (GANs) have made great success in synthe...
research
03/07/2018

Inferencing Based on Unsupervised Learning of Disentangled Representations

Combining Generative Adversarial Networks (GANs) with encoders that lear...
research
07/30/2023

StylePrompter: All Styles Need Is Attention

GAN inversion aims at inverting given images into corresponding latent c...
research
08/26/2020

Disentangled Adversarial Autoencoder for Subject-Invariant Physiological Feature Extraction

Recent developments in biosignal processing have enabled users to exploi...
research
04/15/2020

Disentangled Adversarial Transfer Learning for Physiological Biosignals

Recent developments in wearable sensors demonstrate promising results fo...

Please sign up or login with your details

Forgot password? Click here to reset