From a Point Cloud to a Simulation Model: Bayesian Segmentation and Entropy based Uncertainty Estimation for 3D Modelling

02/04/2021
by   Christina Petschnigg, et al.
4

The 3D modelling of indoor environments and the generation of process simulations play an important role in factory and assembly planning. In brownfield planning cases existing data are often outdated and incomplete especially for older plants, which were mostly planned in 2D. Thus, current environment models cannot be generated directly on the basis of existing data and a holistic approach on how to build such a factory model in a highly automated fashion is mostly non-existent. Major steps in generating an environment model in a production plant include data collection and pre-processing, object identification as well as pose estimation. In this work, we elaborate a methodical workflow, which starts with the digitalization of large-scale indoor environments and ends with the generation of a static environment or simulation model. The object identification step is realized using a Bayesian neural network capable of point cloud segmentation. We elaborate how the information on network uncertainty generated by a Bayesian segmentation framework can be used in order to build up a more accurate environment model. The steps of data collection and point cloud segmentation as well as the resulting model accuracy are evaluated on a real-world data set collected at the assembly line of a large-scale automotive production plant. The segmentation network is further evaluated on the publicly available Stanford Large-Scale 3D Indoor Spaces data set. The Bayesian segmentation network clearly surpasses the performance of the frequentist baseline and allows us to increase the accuracy of the model placement in a simulation scene considerably.

READ FULL TEXT

page 7

page 12

page 14

page 15

page 17

page 20

research
12/13/2020

Uncertainty Estimation in Deep Neural Networks for Point Cloud Segmentation in Factory Planning

The digital factory provides undoubtedly a great potential for future pr...
research
08/13/2019

Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World Data

Deep learning techniques for point cloud data have demonstrated great po...
research
12/13/2019

Deep-learning-based classification and retrieval of components of a process plant from segmented point clouds

Technology to recognize the type of component represented by a point clo...
research
08/14/2021

Data Generation for Learning to Grasp in a Bin-picking Scenario

The rise of deep learning has greatly transformed the pipeline of roboti...
research
02/18/2019

Multi-view Incremental Segmentation of 3D Point Clouds for Mobile Robots

Mobile robots need to create high-definition 3D maps of the environment ...
research
08/21/2020

Generating synthetic photogrammetric data for training deep learning based 3D point cloud segmentation models

At I/ITSEC 2019, the authors presented a fully-automated workflow to seg...
research
03/16/2020

Scan2Plan: Efficient Floorplan Generation from 3D Scans of Indoor Scenes

We introduce Scan2Plan, a novel approach for accurate estimation of a fl...

Please sign up or login with your details

Forgot password? Click here to reset