Towards Real-time 3D Reconstruction using Consumer UAVs

02/26/2019
by   Qiaosong Wang, et al.
0

We present a near real-time solution for 3D reconstruction from aerial images captured by consumer UAVs. Our core idea is to simplify the multi-view stereo problem into a series of two-view stereo matching problems. Our method applies to UAVs equipped with only one camera and does not require special stereo capturing setups. We found that the neighboring two video frames taken by UAVs flying at a mid-to-high cruising altitude can be approximated as left and right views from a virtual stereo camera. Leveraging GPU-accelerated real-time stereo estimation and efficient PnP correspondence solving algorithms, our system simultaneously predicts scene geometry and camera position/orientation from the virtual stereo cameras. Also, this method allows user-selection of varying baseline lengths, which provides more flexibility given the trade-off between camera resolution, effective measuring distance, flight altitude and mapping accuracy. Our method outputs dense point clouds at a constant speed of 25 frames per second and is validated on a variety of real-world datasets with satisfactory results.

READ FULL TEXT

page 2

page 5

page 7

research
11/29/2022

PatchMatch-Stereo-Panorama, a fast dense reconstruction from 360° video images

This work proposes a new method for real-time dense 3d reconstruction fo...
research
04/21/2021

Real-time dense 3D Reconstruction from monocular video data captured by low-cost UAVs

Real-time 3D reconstruction enables fast dense mapping of the environmen...
research
09/17/2019

Real-Time Variational Fisheye Stereo without Rectification and Undistortion

Dense 3D maps from wide-angle cameras is beneficial to robotics applicat...
research
09/10/2020

Distributed Variable-Baseline Stereo SLAM from two UAVs

VIO has been widely used and researched to control and aid the automatio...
research
09/28/2018

Extrinsic camera calibration method and its performance evaluation

This paper presents a method for extrinsic camera calibration (estimatio...
research
08/01/2013

Hybrid Focal Stereo Networks for Pattern Analysis in Homogeneous Scenes

In this paper we address the problem of multiple camera calibration in t...
research
07/18/2022

Efficient View Clustering and Selection for City-Scale 3D Reconstruction

Image datasets have been steadily growing in size, harming the feasibili...

Please sign up or login with your details

Forgot password? Click here to reset