Be your own Benchmark: No-Reference Trajectory Metric on Registered Point Clouds

by   Anastasiia Kornilova, et al.

This paper addresses the problem of assessing trajectory quality in conditions when no ground truth poses are available or when their accuracy is not enough for the specific task - for example, small-scale mapping in outdoor scenes. In our work, we propose a no-reference metric, Mutually Orthogonal Metric (MOM), that estimates the quality of the map from registered point clouds via the trajectory poses. MOM strongly correlates with full-reference trajectory metric Relative Pose Error, making it a trajectory benchmarking tool on setups where 3D sensing technologies are employed. We provide a mathematical foundation for such correlation and confirm it statistically in synthetic environments. Furthermore, since our metric uses a subset of points from mutually orthogonal surfaces, we provide an algorithm for the extraction of such subset and evaluate its performance in synthetic CARLA environment and on KITTI dataset.



There are no comments yet.


page 1

page 6


Quantifying point cloud realism through adversarially learned latent representations

Judging the quality of samples synthesized by generative models can be t...

3D Lidar Mapping Relative Accuracy Automatic Evaluation Algorithm

HD (High Definition) map based on 3D lidar plays a vital role in autonom...

OpenTraj: Assessing Prediction Complexity in Human Trajectories Datasets

Human Trajectory Prediction (HTP) has gained much momentum in the last y...

Difference of Normals as a Multi-Scale Operator in Unorganized Point Clouds

A novel multi-scale operator for unorganized 3D point clouds is introduc...

A Benchmark for Point Clouds Registration Algorithms

Point clouds registration is a fundamental step of many point clouds pro...

3D-VField: Learning to Adversarially Deform Point Clouds for Robust 3D Object Detection

As 3D object detection on point clouds relies on the geometrical relatio...

Assessing virtualization effects in simulations of distributed robotics

In this work, our aim is to identify whether the choice of virtualizatio...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.