DeepAI AI Chat
Log In Sign Up

3D Appearance Super-Resolution with Deep Learning

06/03/2019
by   Yawei Li, et al.
ETH Zurich
9

We tackle the problem of retrieving high-resolution (HR) texture maps of objects that are captured from multiple view points. In the multi-view case, model-based super-resolution (SR) methods have been recently proved to recover high quality texture maps. On the other hand, the advent of deep learning-based methods has already a significant impact on the problem of video and image SR. Yet, a deep learning-based approach to super-resolve the appearance of 3D objects is still missing. The main limitation of exploiting the power of deep learning techniques in the multi-view case is the lack of data. We introduce a 3D appearance SR (3DASR) dataset based on the existing ETH3D [42], SyB3R [31], MiddleBury, and our Collection of 3D scenes from TUM [21], Fountain [51] and Relief [53]. We provide the high- and low-resolution texture maps, the 3D geometric model, images and projection matrices. We exploit the power of 2D learning-based SR methods and design networks suitable for the 3D multi-view case. We incorporate the geometric information by introducing normal maps and further improve the learning process. Experimental results demonstrate that our proposed networks successfully incorporate the 3D geometric information and super-resolve the texture maps.

READ FULL TEXT

page 7

page 13

page 14

page 15

page 16

page 17

page 18

page 19

01/14/2020

Learned Multi-View Texture Super-Resolution

We present a super-resolution method capable of creating a high-resoluti...
07/18/2022

Geometry-Aware Reference Synthesis for Multi-View Image Super-Resolution

Recent multi-view multimedia applications struggle between high-resoluti...
07/28/2021

Improving Multi-View Stereo via Super-Resolution

Today, Multi-View Stereo techniques are able to reconstruct robust and d...
08/31/2021

Super-Resolution Appearance Transfer for 4D Human Performances

A common problem in the 4D reconstruction of people from multi-view vide...
05/23/2023

Multi-BVOC Super-Resolution Exploiting Compounds Inter-Connection

Biogenic Volatile Organic Compounds (BVOCs) emitted from the terrestrial...
06/28/2017

Super-Resolution via Deep Learning

The recent phenomenal interest in convolutional neural networks (CNNs) m...
06/30/2022

PhySRNet: Physics informed super-resolution network for application in computational solid mechanics

Traditional approaches based on finite element analyses have been succes...

Code Repositories

3D_Appearance_SR

This is the official website of our work 3D Appearance Super-Resolution with Deep Learning published on CVPR2019.


view repo