Matthias Nießner

research

∙ 05/03/2022

End2End Multi-View Feature Matching using Differentiable Pose Optimization

Learning-based approaches have become indispensable for camera pose esti...

Barbara Roessle, et al. ∙

research

∙ 04/07/2022

AutoRF: Learning 3D Object Radiance Fields from Single View Observations

We introduce AutoRF - a new approach for learning neural 3D object repre...

Norman Müller, et al. ∙

research

∙ 04/06/2022

Audio-Visual Person-of-Interest DeepFake Detection

Face manipulation technology is advancing very rapidly, and new methods ...

Davide Cozzolino, et al. ∙

research

∙ 04/05/2022

Texturify: Generating Textures on 3D Shape Surfaces

Texture cues on 3D objects are key to compelling visual representations,...

Yawar Siddiqui, et al. ∙

research

∙ 03/31/2022

3D Equivariant Graph Implicit Functions

In recent years, neural implicit representations have made remarkable pr...

Yunlu Chen, et al. ∙

research

∙ 12/06/2021

Dense Depth Priors for Neural Radiance Fields from Sparse Input Views

Neural radiance fields (NeRF) encode a scene into a neural representatio...

Barbara Roessle, et al. ∙

research

∙ 12/06/2021

4DContrast: Contrastive Learning with Dynamic Correspondences for 3D Scene Understanding

We present a new approach to instill 4D dynamic object priors into learn...

Yujin Chen, et al. ∙

research

∙ 12/03/2021

ROCA: Robust CAD Model Retrieval and Alignment from a Single Image

We present ROCA, a novel end-to-end approach that retrieves and aligns 3...

Can Gümeli, et al. ∙

research

∙ 12/02/2021

Neural Head Avatars from Monocular RGB Videos

We present Neural Head Avatars, a novel neural representation that expli...

Philip-William Grassal, et al. ∙

research

∙ 12/02/2021

StyleMesh: Style Transfer for Indoor 3D Scene Reconstructions

We apply style transfer on mesh reconstructions of indoor scenes. This e...

Lukas Höllein, et al. ∙

research

∙ 12/01/2021

Pose2Room: Understanding 3D Scenes from Human Activities

With wearable IMU sensors, one can estimate human poses from wearable de...

Yinyu Nie, et al. ∙

research

∙ 11/03/2021

Panoptic 3D Scene Reconstruction From a Single RGB Image

Understanding 3D scenes from a single image is fundamental to a wide var...

Manuel Dahnert, et al. ∙

research

∙ 07/07/2021

Egocentric Videoconferencing

We introduce a method for egocentric videoconferencing that enables hand...

Mohamed Elgharib, et al. ∙

research

∙ 07/05/2021

TransformerFusion: Monocular RGB Scene Reconstruction using Transformers

We introduce TransformerFusion, a transformer-based 3D scene reconstruct...

Aljaž Božič, et al. ∙

research

∙ 04/22/2021

Pri3D: Can 3D Priors Help 2D Representation Learning?

Recent advances in 3D perception have shown impressive progress in under...

Ji Hou, et al. ∙

research

∙ 04/09/2021

Neural RGB-D Surface Reconstruction

In this work, we explore how to leverage the success of implicit novel v...

Dejan Azinović, et al. ∙

research

∙ 04/08/2021

Dynamic Surface Function Networks for Clothed Human Bodies

We present a novel method for temporal coherent reconstruction and track...

Andrei Burov, et al. ∙

research

∙ 04/01/2021

NPMs: Neural Parametric Models for 3D Deformable Shapes

Parametric 3D models have enabled a wide variety of tasks in computer gr...

Pablo Palafox, et al. ∙

research

∙ 03/31/2021

RetrievalFuse: Neural 3D Scene Reconstruction with a Database

3D reconstruction of large scenes is a challenging problem due to the hi...

Yawar Siddiqui, et al. ∙

research

∙ 01/15/2021

Catching Out-of-Context Misinformation with Self-supervised Learning

Despite the recent attention to DeepFakes and other forms of image manip...

Shivangi Aneja, et al. ∙

research

∙ 12/17/2020

SceneFormer: Indoor Scene Generation with Transformers

The task of indoor scene generation is to generate a sequence of objects...

Xinpeng Wang, et al. ∙

research

∙ 12/16/2020

Exploring Data-Efficient 3D Scene Understanding with Contrastive Scene Contexts

The rapid progress in 3D scene understanding has come with growing deman...

Ji Hou, et al. ∙

research

∙ 12/15/2020

Seeing Behind Objects for 3D Multi-Object Tracking in RGB-D Sequences

Multi-object tracking from RGB-D video sequences is a challenging proble...

Norman Müller, et al. ∙

research

∙ 12/08/2020

Vid2CAD: CAD Model Alignment using Multi-View Constraints from Videos

We address the task of aligning CAD models to a video sequence of a comp...

Kevis-Kokitsi Maninis, et al. ∙

research

∙ 12/05/2020

Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstruction

We present dynamic neural radiance fields for modeling the appearance an...

Guy Gafni, et al. ∙

research

∙ 12/04/2020

ID-Reveal: Identity-aware DeepFake Video Detection

State-of-the-art DeepFake forgery detectors are trained in a supervised ...

Davide Cozzolino, et al. ∙

research

∙ 12/02/2020

Neural Deformation Graphs for Globally-consistent Non-rigid Reconstruction

We introduce Neural Deformation Graphs for globally-consistent deformati...

Aljaž Božič, et al. ∙

research

∙ 11/30/2020

RfD-Net: Point Scene Understanding by Semantic Instance Reconstruction

Semantic scene understanding from point clouds is particularly challengi...

Yinyu Nie, et al. ∙

research

∙ 07/29/2020

Face2Face: Real-time Face Capture and Reenactment of RGB Videos

We present Face2Face, a novel approach for real-time facial reenactment ...

Justus Thies, et al. ∙

research

∙ 06/29/2020

Intrinsic Autoencoders for Joint Neural Rendering and Intrinsic Image Decomposition

Neural rendering techniques promise efficient photo-realistic image synt...

Hassan Abu Alhaija, et al. ∙

research

∙ 06/25/2020

SPSG: Self-Supervised Photometric Scene Generation from RGB-D Scans

We present SPSG, a novel approach to generate high-quality, colored 3D m...

Angela Dai, et al. ∙

research

∙ 06/23/2020

Neural Non-Rigid Tracking

We introduce a novel, end-to-end learnable, differentiable non-rigid tra...

Aljaž Božič, et al. ∙

research

∙ 06/21/2020

Generalized Zero and Few-Shot Transfer for Facial Forgery Detection

We propose Deep Distribution Transfer(DDT), a new transfer learning appr...

Shivangi Aneja, et al. ∙

research

∙ 04/08/2020

State of the Art on Neural Rendering

Efficient rendering of photo-realistic virtual worlds is a long standing...

Ayush Tewari, et al. ∙

research

∙ 03/30/2020

3D-MPA: Multi Proposal Aggregation for 3D Semantic Instance Segmentation

We present 3D-MPA, a method for instance segmentation on 3D point clouds...

Francis Engelmann, et al. ∙

research

∙ 03/27/2020

SceneCAD: Predicting Object Alignments and Layouts in RGB-D Scans

We present a novel approach to reconstructing lightweight, CAD-based rep...

Armen Avetisyan, et al. ∙

research

∙ 03/27/2020

Modeling 3D Shapes by Reinforcement Learning

We explore how to enable machines to model 3D shapes like human modelers...

Cheng Lin, et al. ∙

research

∙ 03/19/2020

Local Implicit Grid Representations for 3D Scenes

Shape priors learned from data are commonly used to reconstruct 3D objec...

Chiyu "Max" Jiang, et al. ∙

research

∙ 03/18/2020

Adversarial Texture Optimization from RGB-D Scans

Realistic color texture generation is an important step in RGB-D surface...

Jingwei Huang, et al. ∙

research

∙ 12/18/2019

ScanRefer: 3D Object Localization in RGB-D Scans using Natural Language

We introduce the new task of 3D object localization in RGB-D scans using...

Dave Zhenyu Chen, et al. ∙

research

∙ 12/11/2019

Neural Voice Puppetry: Audio-driven Facial Reenactment

We present Neural Voice Puppetry, a novel approach for audio-driven faci...

Justus Thies, et al. ∙

research

∙ 12/09/2019

DeepDeform: Learning Non-rigid RGB-D Reconstruction with Semi-supervised Data

Applying data-driven approaches to non-rigid 3D reconstruction has been ...

Aljaž Božič, et al. ∙

research

∙ 11/29/2019

SG-NN: Sparse Generative Neural Networks for Self-Supervised Scene Completion of RGB-D Scans

We present a novel approach that converts partial and noisy RGB-D scans ...

Angela Dai, et al. ∙

research

∙ 11/27/2019

SpoC: Spoofing Camera Fingerprints

Thanks to the fast progress in synthetic media generation, creating real...

Davide Cozzolino, et al. ∙

research

∙ 11/26/2019

ViewAL: Active Learning with Viewpoint Entropy for Semantic Segmentation

We propose ViewAL, a novel active learning strategy for semantic segment...

Yawar Siddiqui, et al. ∙

research

∙ 08/19/2019

Joint Embedding of 3D Scan and CAD Objects

3D scan geometry and CAD models often contain complementary information ...

Manuel Dahnert, et al. ∙

research

∙ 08/16/2019

RIO: 3D Object Instance Re-Localization in Changing Indoor Environments

In this work, we introduce the task of 3D object instance re-localizatio...

Johanna Wald, et al. ∙

research

∙ 06/18/2019

Active Scene Understanding via Online Semantic Reconstruction

We propose a novel approach to robot-operated active understanding of un...

Lintao Zheng, et al. ∙

research

∙ 06/10/2019

End-to-End CAD Model Retrieval and 9DoF Alignment in 3D Scans

We present a novel, end-to-end approach to align CAD models to an 3D sca...

Armen Avetisyan, et al. ∙

research

∙ 04/28/2019

Deferred Neural Rendering: Image Synthesis using Neural Textures

The modern computer graphics pipeline can synthesize images at remarkabl...

Justus Thies, et al. ∙

Matthias Nießner

Featured Co-authors