Neural Camera Models

08/27/2022
by   Igor Vasiljevic, et al.
63

Modern computer vision has moved beyond the domain of internet photo collections and into the physical world, guiding camera-equipped robots and autonomous cars through unstructured environments. To enable these embodied agents to interact with real-world objects, cameras are increasingly being used as depth sensors, reconstructing the environment for a variety of downstream reasoning tasks. Machine-learning-aided depth perception, or depth estimation, predicts for each pixel in an image the distance to the imaged scene point. While impressive strides have been made in depth estimation, significant challenges remain: (1) ground truth depth labels are difficult and expensive to collect at scale, (2) camera information is typically assumed to be known, but is often unreliable and (3) restrictive camera assumptions are common, even though a great variety of camera types and lenses are used in practice. In this thesis, we focus on relaxing these assumptions, and describe contributions toward the ultimate goal of turning cameras into truly generic depth sensors.

READ FULL TEXT

page 22

page 33

page 35

page 37

03/16/2018

Monocular Fisheye Camera Depth Estimation Using Semi-supervised Sparse Velodyne Data

Near field depth estimation around a self driving car is an important fu...
06/03/2019

Y-GAN: A Generative Adversarial Network for Depthmap Estimation from Multi-camera Stereo Images

Depth perception is a key component for autonomous systems that interact...
03/21/2019

Quantitative Depth Quality Assessment of RGBD Cameras At Close Range Using 3D Printed Fixtures

Mobile robots that manipulate their environments require high-accuracy s...
11/10/2015

3D Time-lapse Reconstruction from Internet Photos

Given an Internet photo collection of a landmark, we compute a 3D time-l...
11/26/2010

Formulation Of A N-Degree Polynomial For Depth Estimation using a Single Image

The depth of a visible surface of a scene is the distance between the su...
03/09/2022

Simulation of Plenoptic Cameras

Plenoptic cameras enable the capturing of spatial as well as angular col...
03/06/2022

Precise Point Spread Function Estimation

Point spread function (PSF) plays a crucial role in many fields, such as...