Surface HOF: Surface Reconstruction from a Single Image Using Higher Order Function Networks

12/18/2019
by   ZiYun Wang, et al.
17

We address the problem of generating a high-resolution surface reconstruction from a single image. Our approach is to learn a Higher Order Function (HOF) which takes an image of an object as input and generates a mapping function. The mapping function takes samples from a canonical domain (e.g. the unit sphere) and maps each sample to a local tangent plane on the 3D reconstruction of the object. Each tangent plane is represented as an origin point and a normal vector at that point. By efficiently learning a continuous mapping function, the surface can be generated at arbitrary resolution in contrast to other methods which generate fixed resolution outputs. We present the Surface HOF in which both the higher order function and the mapping function are represented as neural networks, and train the networks to generate reconstructions of PointNet objects. Experiments show that Surface HOF is more accurate and uses more efficient representations than other state of the art methods for surface reconstruction. Surface HOF is also easier to train: it requires minimal input pre-processing and output post-processing and generates surface representations that are more parameter efficient. Its accuracy and convenience make Surface HOF an appealing method for single image reconstruction.

READ FULL TEXT

page 1

page 2

page 6

research
07/24/2019

Higher-Order Function Networks for Learning Composable 3D Object Representations

We present a method to represent 3D objects using higher order functions...
research
01/05/2021

Pixel2point: 3D Object Reconstruction From a Single Image Using CNN and Initial Sphere

3D reconstruction from a single image has many useful applications. Howe...
research
12/27/2018

Surface Networks via General Covers

Developing deep learning techniques for geometric data is an active and ...
research
06/14/2020

Geodesic-HOF: 3D Reconstruction Without Cutting Corners

Single-view 3D object reconstruction is a challenging fundamental proble...
research
08/08/2022

PlaneFormers: From Sparse View Planes to 3D Reconstruction

We present an approach for the planar surface reconstruction of a scene ...
research
07/16/2023

Surface Geometry Processing: An Efficient Normal-based Detail Representation

With the rapid development of high-resolution 3D vision applications, th...
research
07/12/2016

A Machine learning approach for Shape From Shading

The aim of Shape From Shading (SFS) problem is to reconstruct the relief...

Please sign up or login with your details

Forgot password? Click here to reset