Super-resolution of Omnidirectional Images Using Adversarial Learning

by   Cagri Ozcinar, et al.

An omnidirectional image (ODI) enables viewers to look in every direction from a fixed point through a head-mounted display providing an immersive experience compared to that of a standard image. Designing immersive virtual reality systems with ODIs is challenging as they require high resolution content. In this paper, we study super-resolution for ODIs and propose an improved generative adversarial network based model which is optimized to handle the artifacts obtained in the spherical observational space. Specifically, we propose to use a fast PatchGAN discriminator, as it needs fewer parameters and improves the super-resolution at a fine scale. We also explore the generative models with adversarial learning by introducing a spherical-content specific loss function, called 360-SS. To train and test the performance of our proposed model we prepare a dataset of 4500 ODIs. Our results demonstrate the efficacy of the proposed method and identify new challenges in ODI super-resolution for future investigations.



There are no comments yet.


page 3

page 4


Generative adversarial network-based image super-resolution using perceptual content losses

In this paper, we propose a deep generative adversarial network for supe...

Image Super-Resolution Using a Wavelet-based Generative Adversarial Network

In this paper, we consider the problem of super-resolution recons-tructi...

Learning Implicit Generative Models by Matching Perceptual Features

Perceptual features (PFs) have been used with great success in tasks suc...

Applying VertexShuffle Toward 360-Degree Video Super-Resolution on Focused-Icosahedral-Mesh

With the emerging of 360-degree image/video, augmented reality (AR) and ...

A Single Frame and Multi-Frame Joint Network for 360-degree Panorama Video Super-Resolution

Spherical videos, also known as 360 (panorama) videos, can be viewed wit...

Increasing the accuracy and resolution of precipitation forecasts using deep generative models

Accurately forecasting extreme rainfall is notoriously difficult, but is...

Multigrid Solver With Super-Resolved Interpolation

The multigrid algorithm is an efficient numerical method for solving a v...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.