Neural radiance fields in the industrial and robotics domain: applications, research opportunities and use cases

08/14/2023
by   Eugen Šlapak, et al.
0

The proliferation of technologies, such as extended reality (XR), has increased the demand for high-quality three-dimensional (3D) graphical representations. Industrial 3D applications encompass computer-aided design (CAD), finite element analysis (FEA), scanning, and robotics. However, current methods employed for industrial 3D representations suffer from high implementation costs and reliance on manual human input for accurate 3D modeling. To address these challenges, neural radiance fields (NeRFs) have emerged as a promising approach for learning 3D scene representations based on provided training 2D images. Despite a growing interest in NeRFs, their potential applications in various industrial subdomains are still unexplored. In this paper, we deliver a comprehensive examination of NeRF industrial applications while also providing direction for future research endeavors. We also present a series of proof-of-concept experiments that demonstrate the potential of NeRFs in the industrial domain. These experiments include NeRF-based video compression techniques and using NeRFs for 3D motion estimation in the context of collision avoidance. In the video compression experiment, our results show compression savings up to 48% and 74% for resolutions of 1920x1080 and 300x168, respectively. The motion estimation experiment used a 3D animation of a robotic arm to train Dynamic-NeRF (D-NeRF) and achieved an average peak signal-to-noise ratio (PSNR) of disparity map with the value of 23 dB and an structural similarity index measure (SSIM) 0.97.

READ FULL TEXT

page 1

page 12

page 13

page 15

page 19

research
09/30/2020

Light Field Compression by Residual CNN Assisted JPEG

Light field (LF) imaging has gained significant attention due to its rec...
research
02/28/2020

Improved Image Coding Autoencoder With Deep Learning

In this paper, we build autoencoder based pipelines for extreme end-to-e...
research
04/26/2018

Learning for Video Compression

One key challenge to learning-based video compression is that motion pre...
research
03/31/2022

Desenvolvimento de ferramenta de simulação para auxílio no ensino da disciplina de robótica industrial

Currently, robotics is one of the fastest growing areas not only in the ...
research
02/04/2022

A Tensor Based Regression Approach for Human Motion Prediction

Collaborative robotic systems will be a key enabling technology for curr...
research
06/15/2022

VCT: A Video Compression Transformer

We show how transformers can be used to vastly simplify neural video com...

Please sign up or login with your details

Forgot password? Click here to reset