Super-resolution of Omnidirectional Images Using Adversarial Learning

08/12/2019
by   Cagri Ozcinar, et al.
6

An omnidirectional image (ODI) enables viewers to look in every direction from a fixed point through a head-mounted display providing an immersive experience compared to that of a standard image. Designing immersive virtual reality systems with ODIs is challenging as they require high resolution content. In this paper, we study super-resolution for ODIs and propose an improved generative adversarial network based model which is optimized to handle the artifacts obtained in the spherical observational space. Specifically, we propose to use a fast PatchGAN discriminator, as it needs fewer parameters and improves the super-resolution at a fine scale. We also explore the generative models with adversarial learning by introducing a spherical-content specific loss function, called 360-SS. To train and test the performance of our proposed model we prepare a dataset of 4500 ODIs. Our results demonstrate the efficacy of the proposed method and identify new challenges in ODI super-resolution for future investigations.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 3

page 4

09/13/2018

Generative adversarial network-based image super-resolution using perceptual content losses

In this paper, we propose a deep generative adversarial network for supe...
07/24/2019

Image Super-Resolution Using a Wavelet-based Generative Adversarial Network

In this paper, we consider the problem of super-resolution recons-tructi...
04/04/2019

Learning Implicit Generative Models by Matching Perceptual Features

Perceptual features (PFs) have been used with great success in tasks suc...
06/21/2021

Applying VertexShuffle Toward 360-Degree Video Super-Resolution on Focused-Icosahedral-Mesh

With the emerging of 360-degree image/video, augmented reality (AR) and ...
08/24/2020

A Single Frame and Multi-Frame Joint Network for 360-degree Panorama Video Super-Resolution

Spherical videos, also known as 360 (panorama) videos, can be viewed wit...
03/23/2022

Increasing the accuracy and resolution of precipitation forecasts using deep generative models

Accurately forecasting extreme rainfall is notoriously difficult, but is...
04/28/2021

Multigrid Solver With Super-Resolved Interpolation

The multigrid algorithm is an efficient numerical method for solving a v...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.