DeepAI AI Chat
Log In Sign Up

Learned Multi-View Texture Super-Resolution

01/14/2020
by   Audrey Richard, et al.
26

We present a super-resolution method capable of creating a high-resolution texture map for a virtual 3D object from a set of lower-resolution images of that object. Our architecture unifies the concepts of (i) multi-view super-resolution based on the redundancy of overlapping views and (ii) single-view super-resolution based on a learned prior of high-resolution (HR) image structure. The principle of multi-view super-resolution is to invert the image formation process and recover the latent HR texture from multiple lower-resolution projections. We map that inverse problem into a block of suitably designed neural network layers, and combine it with a standard encoder-decoder network for learned single-image super-resolution. Wiring the image formation model into the network avoids having to learn perspective mapping from textures to images, and elegantly handles a varying number of input views. Experiments demonstrate that the combination of multi-view observations and learned prior yields improved texture maps.

READ FULL TEXT

page 1

page 4

page 7

page 8

04/26/2023

Super-NeRF: View-consistent Detail Generation for NeRF super-resolution

The neural radiance field (NeRF) achieved remarkable success in modeling...
06/03/2019

3D Appearance Super-Resolution with Deep Learning

We tackle the problem of retrieving high-resolution (HR) texture maps of...
07/28/2021

Improving Multi-View Stereo via Super-Resolution

Today, Multi-View Stereo techniques are able to reconstruct robust and d...
08/31/2021

Super-Resolution Appearance Transfer for 4D Human Performances

A common problem in the 4D reconstruction of people from multi-view vide...
03/14/2022

Texture Generation Using Dual-Domain Feature Flow with Multi-View Hallucinations

We propose a dual-domain generative model to estimate a texture map from...
12/09/2022

Neural Volume Super-Resolution

Neural volumetric representations have become a widely adopted model for...
02/27/2018

3D Object Super-Resolution

We consider the problem of scaling deep generative shape models to high-...

Code Repositories

Large-Scale-Image-Super-Resolution

None


view repo