Single-View Hair Reconstruction using Convolutional Neural Networks

06/19/2018
by   Yi Zhou, et al.
0

We introduce a deep learning-based method to generate full 3D hair geometry from an unconstrained image. Our method can recover local strand details and has real-time performance. State-of-the-art hair modeling techniques rely on large hairstyle collections for nearest neighbor retrieval and then perform ad-hoc refinement. Our deep learning approach, in contrast, is highly efficient in storage and can run 1000 times faster while generating hair with 30K strands. The convolutional neural network takes the 2D orientation field of a hair image as input and generates strand features that are evenly distributed on the parameterized 2D scalp. We introduce a collision loss to synthesize more plausible hairstyles, and the visibility of each strand is also used as a weight term to improve the reconstruction accuracy. The encoder-decoder architecture of our network naturally provides a compact and continuous representation for hairstyles, which allows us to interpolate naturally between hairstyles. We use a large set of rendered synthetic hair models to train our network. Our method scales to real images because an intermediate 2D orientation field, automatically calculated from the real image, factors out the difference between synthetic and real hairs. We demonstrate the effectiveness and robustness of our method on a wide range of challenging real Internet pictures, and show reconstructed hair sequences from videos.

READ FULL TEXT

page 2

page 6

page 8

page 9

page 11

page 16

page 17

page 21

research
06/19/2018

HairNet: Single-View Hair Reconstruction using Convolutional Neural Networks

We introduce a deep learning-based method to generate full 3D hair geome...
research
11/23/2016

Learning Generic Sentence Representations Using Convolutional Neural Networks

We propose a new encoder-decoder approach to learn distributed sentence ...
research
08/04/2018

Non-locally Enhanced Encoder-Decoder Network for Single Image De-raining

Single image rain streaks removal has recently witnessed substantial pro...
research
08/20/2019

DeepSketchHair: Deep Sketch-based 3D Hair Modeling

We present sketchhair, a deep learning based tool for interactive modeli...
research
03/05/2023

HairStep: Transfer Synthetic to Real Using Strand and Depth Maps for Single-View 3D Hair Modeling

In this work, we tackle the challenging problem of learning-based single...
research
09/08/2018

PhaseLink: A Deep Learning Approach to Seismic Phase Association

Seismic phase association is a fundamental task in seismology that perta...
research
03/29/2016

SMASH: Physics-guided Reconstruction of Collisions from Videos

Collision sequences are commonly used in games and entertainment to add ...

Please sign up or login with your details

Forgot password? Click here to reset