DeepAI AI Chat
Log In Sign Up

Learned Multi-View Texture Super-Resolution

by   Audrey Richard, et al.

We present a super-resolution method capable of creating a high-resolution texture map for a virtual 3D object from a set of lower-resolution images of that object. Our architecture unifies the concepts of (i) multi-view super-resolution based on the redundancy of overlapping views and (ii) single-view super-resolution based on a learned prior of high-resolution (HR) image structure. The principle of multi-view super-resolution is to invert the image formation process and recover the latent HR texture from multiple lower-resolution projections. We map that inverse problem into a block of suitably designed neural network layers, and combine it with a standard encoder-decoder network for learned single-image super-resolution. Wiring the image formation model into the network avoids having to learn perspective mapping from textures to images, and elegantly handles a varying number of input views. Experiments demonstrate that the combination of multi-view observations and learned prior yields improved texture maps.


page 1

page 4

page 7

page 8


Super-NeRF: View-consistent Detail Generation for NeRF super-resolution

The neural radiance field (NeRF) achieved remarkable success in modeling...

3D Appearance Super-Resolution with Deep Learning

We tackle the problem of retrieving high-resolution (HR) texture maps of...

Improving Multi-View Stereo via Super-Resolution

Today, Multi-View Stereo techniques are able to reconstruct robust and d...

Super-Resolution Appearance Transfer for 4D Human Performances

A common problem in the 4D reconstruction of people from multi-view vide...

Texture Generation Using Dual-Domain Feature Flow with Multi-View Hallucinations

We propose a dual-domain generative model to estimate a texture map from...

Neural Volume Super-Resolution

Neural volumetric representations have become a widely adopted model for...

3D Object Super-Resolution

We consider the problem of scaling deep generative shape models to high-...

Code Repositories



view repo