DeepAI AI Chat
Log In Sign Up

Pixel VQ-VAEs for Improved Pixel Art Representation

03/23/2022
by   Akash Saravanan, et al.
0

Machine learning has had a great deal of success in image processing. However, the focus of this work has largely been on realistic images, ignoring more niche art styles such as pixel art. Additionally, many traditional machine learning models that focus on groups of pixels do not work well with pixel art, where individual pixels are important. We propose the Pixel VQ-VAE, a specialized VQ-VAE model that learns representations of pixel art. We show that it outperforms other models in both the quality of embeddings as well as performance on downstream tasks.

READ FULL TEXT

page 5

page 6

page 10

page 11

page 12

page 13

11/10/2018

Fully Convolutional Network with Multi-Step Reinforcement Learning for Image Processing

This paper tackles a new problem setting: reinforcement learning with pi...
05/19/2020

Unsupervised anomaly localization using VAE and beta-VAE

Variational Auto-Encoders (VAEs) have shown great potential in the unsup...
07/30/2019

4X4 Census Transform

This paper proposes a 4X4 Census Transform (4X4CT) to encourage further ...
12/16/2019

PixelRL: Fully Convolutional Network with Reinforcement Learning for Image Processing

This paper tackles a new problem setting: reinforcement learning with pi...
07/14/2022

Language Modelling with Pixels

Language models are defined over a finite set of inputs, which creates a...
06/22/2015

Adaptive Digital Scan Variable Pixels

The square and rectangular shape of the pixels in the digital images for...
01/24/2019

Learning Vector Representation of Content and Matrix Representation of Change: Towards a Representational Model of V1

This paper entertains the hypothesis that the primary purpose of the cel...