NEF: Neural Edge Fields for 3D Parametric Curve Reconstruction from Multi-view Images

03/14/2023
by   Yunfan Ye, et al.
0

We study the problem of reconstructing 3D feature curves of an object from a set of calibrated multi-view images. To do so, we learn a neural implicit field representing the density distribution of 3D edges which we refer to as Neural Edge Field (NEF). Inspired by NeRF, NEF is optimized with a view-based rendering loss where a 2D edge map is rendered at a given view and is compared to the ground-truth edge map extracted from the image of that view. The rendering-based differentiable optimization of NEF fully exploits 2D edge detection, without needing a supervision of 3D edges, a 3D geometric operator or cross-view edge correspondence. Several technical designs are devised to ensure learning a range-limited and view-independent NEF for robust edge extraction. The final parametric 3D curves are extracted from NEF with an iterative optimization method. On our benchmark with synthetic data, we demonstrate that NEF outperforms existing state-of-the-art methods on all metrics. Project page: https://yunfan1202.github.io/NEF/.

READ FULL TEXT

page 4

page 7

page 8

page 12

research
03/27/2023

NeUDF: Learning Unsigned Distance Fields from Multi-view Images for Reconstructing Non-watertight Models

Volume rendering-based 3D reconstruction from multi-view images has gain...
research
09/20/2023

Language-driven Object Fusion into Neural Radiance Fields with Pose-Conditioned Dataset Updates

Neural radiance field is an emerging rendering method that generates hig...
research
03/29/2023

NerVE: Neural Volumetric Edges for Parametric Curve Extraction from Point Cloud

Extracting parametric edge curves from point clouds is a fundamental pro...
research
07/04/2022

Aug-NeRF: Training Stronger Neural Radiance Fields with Triple-Level Physically-Grounded Augmentations

Neural Radiance Field (NeRF) regresses a neural parameterized scene by d...
research
01/17/2018

Multi-View Stereo 3D Edge Reconstruction

This paper presents a novel method for the reconstruction of 3D edges in...
research
06/22/2017

On Detection of Faint Edges in Noisy Images

A fundamental question for edge detection in noisy images is how faint c...
research
11/24/2022

ScanNeRF: a Scalable Benchmark for Neural Radiance Fields

In this paper, we propose the first-ever real benchmark thought for eval...

Please sign up or login with your details

Forgot password? Click here to reset