Image Colorization By Capsule Networks

08/22/2019
by   Gökhan Özbulak, et al.
8

In this paper, a simple topology of Capsule Network (CapsNet) is investigated for the problem of image colorization. The generative and segmentation capabilities of the original CapsNet topology, which is proposed for image classification problem, is leveraged for the colorization of the images by modifying the network as follows:1) The original CapsNet model is adapted to map the grayscale input to the output in the CIE Lab colorspace, 2) The feature detector part of the model is updated by using deeper feature layers inherited from VGG-19 pre-trained model with weights in order to transfer low-level image representation capability to this model, 3) The margin loss function is modified as Mean Squared Error (MSE) loss to minimize the image-to-imagemapping. The resulting CapsNet model is named as Colorizer Capsule Network (ColorCapsNet).The performance of the ColorCapsNet is evaluated on the DIV2K dataset and promising results are obtained to investigate Capsule Networks further for image colorization problem.

READ FULL TEXT

page 1

page 3

page 4

page 7

page 8

research
02/17/2018

CapsuleGAN: Generative Adversarial Capsule Network

We present Generative Adversarial Capsule Network (CapsuleGAN), a framew...
research
06/11/2018

Generative Adversarial Network Architectures For Image Synthesis Using Capsule Networks

In this paper, we propose Generative Adversarial Network (GAN) architect...
research
09/22/2022

Capsule Network based Contrastive Learning of Unsupervised Visual Representations

Capsule Networks have shown tremendous advancement in the past decade, o...
research
02/07/2020

Subspace Capsule Network

Convolutional neural networks (CNNs) have become a key asset to most of ...
research
05/19/2018

CapProNet: Deep Feature Learning via Orthogonal Projections onto Capsule Subspaces

In this paper, we formalize the idea behind capsule nets of using a caps...
research
04/17/2018

Sparse Unsupervised Capsules Generalize Better

We show that unsupervised training of latent capsule layers using only t...
research
12/17/2021

Improving evidential deep learning via multi-task learning

The Evidential regression network (ENet) estimates a continuous target a...

Please sign up or login with your details

Forgot password? Click here to reset