Neural Strands: Learning Hair Geometry and Appearance from Multi-View Images

07/28/2022
by   Radu Alexandru Rosu, et al.
0

We present Neural Strands, a novel learning framework for modeling accurate hair geometry and appearance from multi-view image inputs. The learned hair model can be rendered in real-time from any viewpoint with high-fidelity view-dependent effects. Our model achieves intuitive shape and style control unlike volumetric counterparts. To enable these properties, we propose a novel hair representation based on a neural scalp texture that encodes the geometry and appearance of individual strands at each texel location. Furthermore, we introduce a novel neural rendering framework based on rasterization of the learned hair strands. Our neural rendering is strand-accurate and anti-aliased, making the rendering view-consistent and photorealistic. Combining appearance with a multi-view geometric prior, we enable, for the first time, the joint learning of appearance and explicit hair geometry from a multi-view setup. We demonstrate the efficacy of our approach in terms of fidelity and efficiency for various hairstyles.

READ FULL TEXT

page 2

page 11

page 12

page 13

page 14

research
03/24/2023

GM-NeRF: Learning Generalizable Model-based Neural Radiance Fields from Multi-view Images

In this work, we focus on synthesizing high-fidelity novel view images f...
research
08/01/2018

Deep Appearance Models for Face Rendering

We introduce a deep appearance model for rendering the human face. Inspi...
research
11/26/2018

IGNOR: Image-guided Neural Object Rendering

We propose a new learning-based novel view synthesis approach for scanne...
research
07/07/2023

AutoDecoding Latent 3D Diffusion Models

We present a novel approach to the generation of static and articulated ...
research
08/29/2020

ClipFlip : Multi-view Clipart Design

We present an assistive system for clipart design by providing visual sc...
research
02/09/2023

MEGANE: Morphable Eyeglass and Avatar Network

Eyeglasses play an important role in the perception of identity. Authent...
research
01/25/2023

Ultra-NeRF: Neural Radiance Fields for Ultrasound Imaging

We present a physics-enhanced implicit neural representation (INR) for u...

Please sign up or login with your details

Forgot password? Click here to reset