Omni-Directional Image Generation from Single Snapshot Image

10/12/2020
by   Keisuke Okubo, et al.
0

An omni-directional image (ODI) is the image that has a field of view covering the entire sphere around the camera. The ODIs have begun to be used in a wide range of fields such as virtual reality (VR), robotics, and social network services. Although the contents using ODI have increased, the available images and videos are still limited, compared with widespread snapshot images. A large number of ODIs are desired not only for the VR contents, but also for training deep learning models for ODI. For these purposes, a novel computer vision task to generate ODI from a single snapshot image is proposed in this paper. To tackle this problem, the conditional generative adversarial network was applied in combination with class-conditioned convolution layers. With this novel task, VR images and videos will be easily created even with a smartphone camera.

READ FULL TEXT

page 1

page 2

page 3

page 7

research
03/10/2021

Learning to compose 6-DoF omnidirectional videos using multi-sphere images

Omnidirectional video is an essential component of Virtual Reality. Alth...
research
10/23/2022

Facial De-occlusion Network for Virtual Telepresence Systems

To see what is not in the image is one of the broader missions of comput...
research
04/07/2019

Visible Light Communication for Next Generation Untethered Virtual Reality Systems

Virtual and augmented reality (VR/AR) systems are emerging technologies ...
research
10/01/2017

Video Generation From Text

Generating videos from text has proven to be a significant challenge for...
research
08/14/2020

MatryODShka: Real-time 6DoF Video View Synthesis using Multi-Sphere Images

We introduce a method to convert stereo 360 (omnidirectional stereo) ima...
research
01/04/2023

Towards a Pipeline for Real-Time Visualization of Faces for VR-based Telepresence and Live Broadcasting Utilizing Neural Rendering

While head-mounted displays (HMDs) for Virtual Reality (VR) have become ...
research
09/15/2023

Increasing diversity of omni-directional images generated from single image using cGAN based on MLPMixer

This paper proposes a novel approach to generating omni-directional imag...

Please sign up or login with your details

Forgot password? Click here to reset