DeepAI AI Chat
Log In Sign Up

3D Appearance Super-Resolution with Deep Learning

by   Yawei Li, et al.
ETH Zurich

We tackle the problem of retrieving high-resolution (HR) texture maps of objects that are captured from multiple view points. In the multi-view case, model-based super-resolution (SR) methods have been recently proved to recover high quality texture maps. On the other hand, the advent of deep learning-based methods has already a significant impact on the problem of video and image SR. Yet, a deep learning-based approach to super-resolve the appearance of 3D objects is still missing. The main limitation of exploiting the power of deep learning techniques in the multi-view case is the lack of data. We introduce a 3D appearance SR (3DASR) dataset based on the existing ETH3D [42], SyB3R [31], MiddleBury, and our Collection of 3D scenes from TUM [21], Fountain [51] and Relief [53]. We provide the high- and low-resolution texture maps, the 3D geometric model, images and projection matrices. We exploit the power of 2D learning-based SR methods and design networks suitable for the 3D multi-view case. We incorporate the geometric information by introducing normal maps and further improve the learning process. Experimental results demonstrate that our proposed networks successfully incorporate the 3D geometric information and super-resolve the texture maps.


page 7

page 13

page 14

page 15

page 16

page 17

page 18

page 19


Learned Multi-View Texture Super-Resolution

We present a super-resolution method capable of creating a high-resoluti...

Geometry-Aware Reference Synthesis for Multi-View Image Super-Resolution

Recent multi-view multimedia applications struggle between high-resoluti...

Improving Multi-View Stereo via Super-Resolution

Today, Multi-View Stereo techniques are able to reconstruct robust and d...

Super-Resolution Appearance Transfer for 4D Human Performances

A common problem in the 4D reconstruction of people from multi-view vide...

Multi-BVOC Super-Resolution Exploiting Compounds Inter-Connection

Biogenic Volatile Organic Compounds (BVOCs) emitted from the terrestrial...

Super-Resolution via Deep Learning

The recent phenomenal interest in convolutional neural networks (CNNs) m...

PhySRNet: Physics informed super-resolution network for application in computational solid mechanics

Traditional approaches based on finite element analyses have been succes...

Code Repositories


This is the official website of our work 3D Appearance Super-Resolution with Deep Learning published on CVPR2019.

view repo