Texturify: Generating Textures on 3D Shape Surfaces

04/05/2022
by   Yawar Siddiqui, et al.
0

Texture cues on 3D objects are key to compelling visual representations, with the possibility to create high visual fidelity with inherent spatial consistency across different views. Since the availability of textured 3D shapes remains very limited, learning a 3D-supervised data-driven method that predicts a texture based on the 3D input is very challenging. We thus propose Texturify, a GAN-based method that leverages a 3D shape dataset of an object class and learns to reproduce the distribution of appearances observed in real images by generating high-quality textures. In particular, our method does not require any 3D color supervision or correspondence between shape geometry and images to learn the texturing of 3D objects. Texturify operates directly on the surface of the 3D objects by introducing face convolutional operators on a hierarchical 4-RoSy parametrization to generate plausible object-specific textures. Employing differentiable rendering and adversarial losses that critique individual views and consistency across views, we effectively learn the high-quality surface texturing distribution from real-world images. Experiments on car and chair shape collections show that our approach outperforms state of the art by an average of 22

READ FULL TEXT

page 1

page 9

page 10

page 12

page 13

page 14

page 23

page 24

research
08/18/2020

Pix2Surf: Learning Parametric 3D Surface Models of Objects from Images

We investigate the problem of learning to generate 3D parametric surface...
research
04/12/2023

Mesh2Tex: Generating Mesh Textures from Image Queries

Remarkable advances have been achieved recently in learning neural repre...
research
11/20/2019

Self-supervised Learning of 3D Objects from Natural Images

We present a method to learn single-view reconstruction of the 3D shape,...
research
01/18/2022

GANmouflage: 3D Object Nondetection with Texture Fields

We propose a method that learns to camouflage 3D objects within scenes. ...
research
03/18/2020

Adversarial Texture Optimization from RGB-D Scans

Realistic color texture generation is an important step in RGB-D surface...
research
04/21/2022

Share With Thy Neighbors: Single-View Reconstruction by Cross-Instance Consistency

Approaches for single-view reconstruction typically rely on viewpoint an...
research
07/09/2021

White-Box Cartoonization Using An Extended GAN Framework

In the present study, we propose to implement a new framework for estima...

Please sign up or login with your details

Forgot password? Click here to reset