Pixel VQ-VAEs for Improved Pixel Art Representation

03/23/2022
by   Akash Saravanan, et al.
0

Machine learning has had a great deal of success in image processing. However, the focus of this work has largely been on realistic images, ignoring more niche art styles such as pixel art. Additionally, many traditional machine learning models that focus on groups of pixels do not work well with pixel art, where individual pixels are important. We propose the Pixel VQ-VAE, a specialized VQ-VAE model that learns representations of pixel art. We show that it outperforms other models in both the quality of embeddings as well as performance on downstream tasks.

READ FULL TEXT

page 5

page 6

page 10

page 11

page 12

page 13

research
05/29/2023

Autoencoding Conditional Neural Processes for Representation Learning

Conditional neural processes (CNPs) are a flexible and efficient family ...
research
11/10/2018

Fully Convolutional Network with Multi-Step Reinforcement Learning for Image Processing

This paper tackles a new problem setting: reinforcement learning with pi...
research
07/30/2019

4X4 Census Transform

This paper proposes a 4X4 Census Transform (4X4CT) to encourage further ...
research
05/19/2020

Unsupervised anomaly localization using VAE and beta-VAE

Variational Auto-Encoders (VAEs) have shown great potential in the unsup...
research
12/16/2019

PixelRL: Fully Convolutional Network with Reinforcement Learning for Image Processing

This paper tackles a new problem setting: reinforcement learning with pi...
research
07/14/2022

Language Modelling with Pixels

Language models are defined over a finite set of inputs, which creates a...
research
12/07/2021

Parallel Discrete Convolutions on Adaptive Particle Representations of Images

We present data structures and algorithms for native implementations of ...

Please sign up or login with your details

Forgot password? Click here to reset