UprightNet: Geometry-Aware Camera Orientation Estimation from Single Images

08/19/2019
by   Wenqi Xian, et al.
0

We introduce UprightNet, a learning-based approach for estimating 2DoF camera orientation from a single RGB image of an indoor scene. Unlike recent methods that leverage deep learning to perform black-box regression from image to orientation parameters, we propose an end-to-end framework that incorporates explicit geometric reasoning. In particular, we design a network that predicts two representations of scene geometry, in both the local camera and global reference coordinate systems, and solves for the camera orientation as the rotation that best aligns these two predictions via a differentiable least squares module. This network can be trained end-to-end, and can be supervised with both ground truth camera poses and intermediate representations of surface geometry. We evaluate UprightNet on the single-image camera orientation task on synthetic and real datasets, and show significant improvements over prior state-of-the-art approaches.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 3

page 6

page 7

page 8

02/27/2020

Visual Camera Re-Localization from RGB and RGB-D Images Using DSAC

We describe a learning-based system that estimates the camera position a...
06/27/2021

Indoor Panorama Planar 3D Reconstruction via Divide and Conquer

Indoor panorama typically consists of human-made structures parallel or ...
12/12/2021

Deep network for rolling shutter rectification

CMOS sensors employ row-wise acquisition mechanism while imaging a scene...
06/10/2017

Exploring Convolutional Networks for End-to-End Visual Servoing

Present image based visual servoing approaches rely on extracting hand c...
09/02/2019

Geometry Normalization Networks for Accurate Scene Text Detection

Large geometry (e.g., orientation) variances are the key challenges in t...
06/26/2019

On the Role of Geometry in Geo-Localization

Humans can build a mental map of a geographical area to find their way a...
11/19/2020

Multi-Plane Program Induction with 3D Box Priors

We consider two important aspects in understanding and editing images: m...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.