Simultaneous drone localisation and wind turbine model fitting during autonomous surface inspection

04/09/2019
by   Oliver Moolan-Feroze, et al.
0

We present a method for simultaneous localisation and wind turbine model fitting for a drone performing an automated surface inspection. We use a skeletal parameterisation of the turbine that can be easily integrated into a non-linear least squares optimiser, combined with a pose graph representation of the drone's 3-D trajectory, allowing us to optimise both sets of parameters simultaneously. Given images from an onboard camera, we use a CNN to infer projections of the skeletal model, enabling correspondence constraints to be established through a cost function. This is then coupled with GPS/IMU measurements taken at key frames in the graph to allow successive optimisation as the drone navigates around the turbine. We present two variants of the cost function, one based on traditional 2D point correspondences and the other on direct image interpolation within the inferred projections. Results from experiments on simulated and real-world data show that simultaneous optimisation provides improvements to localisation over only optimising the pose and that combined use of both cost functions proves most effective.

READ FULL TEXT

page 1

page 3

page 8

research
02/27/2019

Improving drone localisation around wind turbines using monocular model-based tracking

We present a novel method of integrating image-based measurements into a...
research
09/11/2023

Assessing Wind Impact on Semi-Autonomous Drone Landings for In-Contact Power Line Inspection

In recent years, the use of inspection drones has become increasingly po...
research
07/20/2022

Learning to identify cracks on wind turbine blade surfaces using drone-based inspection images

Wind energy is expected to be one of the leading ways to achieve the goa...
research
06/16/2023

Pose Graph Optimization for a MAV Indoor Localization Fusing 5GNR TOA with an IMU

This paper explores the potential of 5G new radio (NR) Time-of-Arrival (...
research
08/08/2022

A Method For Automated Drone Viewpoints to Support Remote Robot Manipulation

Drones can provide a minimally-constrained adapting camera view to suppo...
research
02/02/2016

Fitting a 3D Morphable Model to Edges: A Comparison Between Hard and Soft Correspondences

We propose a fully automatic method for fitting a 3D morphable model to ...
research
12/18/2022

Automated Optical Inspection of FAST's Reflector Surface using Drones and Computer Vision

The Five-hundred-meter Aperture Spherical radio Telescope (FAST) is the ...

Please sign up or login with your details

Forgot password? Click here to reset