Inertial-Based Scale Estimation for Structure from Motion on Mobile Devices

11/29/2016
by   Janne Mustaniemi, et al.
0

Structure from motion algorithms have an inherent limitation that the reconstruction can only be determined up to the unknown scale factor. Modern mobile devices are equipped with an inertial measurement unit (IMU), which can be used for estimating the scale of the reconstruction. We propose a method that recovers the metric scale given inertial measurements and camera poses. In the process, we also perform a temporal and spatial alignment of the camera and the IMU. Therefore, our solution can be easily combined with any existing visual reconstruction software. The method can cope with noisy camera pose estimates, typically caused by motion blur or rolling shutter artifacts, via utilizing a Rauch-Tung-Striebel (RTS) smoother. Furthermore, the scale estimation is performed in the frequency domain, which provides more robustness to inaccurate sensor time stamps and noisy IMU samples than the previously used time domain representation. In contrast to previous methods, our approach has no parameters that need to be tuned for achieving a good performance. In the experiments, we show that the algorithm outperforms the state-of-the-art in both accuracy and convergence speed of the scale estimate. The accuracy of the scale is around 1% from the ground truth depending on the recording. We also demonstrate that our method can improve the scale accuracy of the Project Tango's build-in motion tracking.

READ FULL TEXT

page 1

page 7

research
08/21/2018

Estimating Metric Poses of Dynamic Objects Using Monocular Visual-Inertial Fusion

A monocular 3D object tracking system generally has only up-to-scale pos...
research
09/03/2023

BodySLAM++: Fast and Tightly-Coupled Visual-Inertial Camera and Human Motion Tracking

Robust, fast, and accurate human state - 6D pose and posture - estimatio...
research
06/23/2015

Autonomous 3D Reconstruction Using a MAV

An approach is proposed for high resolution 3D reconstruction of an obje...
research
10/20/2021

DVIO: Depth aided visual inertial odometry for RGBD sensors

In past few years we have observed an increase in the usage of RGBD sens...
research
10/01/2018

Inertial-aided Motion Deblurring with Deep Networks

We propose an inertial-aided deblurring method that incorporates gyrosco...
research
03/22/2020

Monocular visual-inertial SLAM algorithm combined with wheel speed anomaly detection

To address the weak observability of monocular visual-inertial odometers...
research
05/14/2020

Neural Networks Versus Conventional Filters for Inertial-Sensor-based Attitude Estimation

Inertial measurement units are commonly used to estimate the attitude of...

Please sign up or login with your details

Forgot password? Click here to reset