Automatic Content-aware Projection for 360° Videos

04/25/2017
by   Yeong Won Kim, et al.
0

To watch 360 videos on normal 2D displays, we need to project the selected part of the 360 image onto the 2D display plane. In this paper, we propose a fully-automated framework for generating content-aware 2D normal-view perspective videos from 360 videos. Especially, we focus on the projection step preserving important image contents and reducing image distortion. Basically, our projection method is based on Pannini projection model. At first, the salient contents such as linear structures and salient regions in the image are preserved by optimizing the single Panini projection model. Then, the multiple Panini projection models at salient regions are interpolated to suppress image distortion globally. Finally, the temporal consistency for image projection is enforced for producing temporally stable normal-view videos. Our proposed projection method does not require any user-interaction and is much faster than previous content-preserving methods. It can be applied to not only images but also videos taking the temporal consistency of projection into account. Experiments on various 360 videos show the superiority of the proposed projection method quantitatively and qualitatively.

READ FULL TEXT

page 2

page 3

page 4

page 6

page 7

page 9

research
12/28/2021

360° Optical Flow using Tangent Images

Omnidirectional 360 images have found many promising and exciting applic...
research
04/07/2016

Automatic Content-aware Non-Photorealistic Rendering of Images

Non-photorealistic rendering techniques work on image features and often...
research
12/01/2018

AIR: Anywhere Immersive Reality with User-Perspective Projection

Projection-based augmented reality (AR) has much potential, but is limit...
research
06/16/2015

A Novel Semantics and Feature Preserving Perspective for Content Aware Image Retargeting

There is an increasing requirement for efficient image retargeting techn...
research
11/13/2018

Self-Supervised Learning of Depth and Camera Motion from 360° Videos

As 360 cameras become prevalent in many autonomous systems (e.g., self-d...
research
03/31/2018

Snap Angle Prediction for 360^∘ Panorama

360^∘ panoramas are a rich medium, yet notoriously difficult to visualiz...
research
08/28/2020

Distortion-Adaptive Grape Bunch Counting for Omnidirectional Images

This paper proposes the first object counting method for omnidirectional...

Please sign up or login with your details

Forgot password? Click here to reset