Matthias Nießner

research

∙ 05/10/2023

HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motion

Representing human performance at high-fidelity is an essential building...

0 Mustafa Işık, et al. ∙

research

∙ 05/04/2023

NeRSemble: Multi-view Radiance Field Reconstruction of Human Heads

We focus on reconstructing high-fidelity radiance fields of human heads,...

0 Tobias Kirschstein, et al. ∙

research

∙ 03/29/2023

HyperDiffusion: Generating Implicit Neural Fields with Weight-Space Diffusion

Implicit neural fields, typically encoded by a multilayer perceptron (ML...

0 Ziya Erkoç, et al. ∙

research

∙ 03/24/2023

DiffuScene: Scene Graph Denoising Diffusion Probabilistic Model for Generative Indoor Scene Synthesis

We present DiffuScene for indoor 3D scene synthesis based on a novel sce...

0 Jiapeng Tang, et al. ∙

research

∙ 03/23/2023

TriPlaneNet: An Encoder for EG3D Inversion

Recent progress in NeRF-based GANs has introduced a number of approaches...

1 Ananta R. Bhattarai, et al. ∙

research

∙ 03/21/2023

Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Models

We present Text2Room, a method for generating room-scale textured 3D mes...

0 Lukas Höllein, et al. ∙

research

∙ 02/28/2023

Mask3D: Pre-training 2D Vision Transformers by Learning Masked 3D Priors

Current popular backbones in computer vision, such as Vision Transformer...

0 Ji Hou, et al. ∙

research

∙ 12/19/2022

Panoptic Lifting for 3D Scene Understanding with Neural Fields

We propose Panoptic Lifting, a novel approach for learning panoptic 3D v...

0 Yawar Siddiqui, et al. ∙

research

∙ 12/06/2022

Learning Neural Parametric Head Models

We propose a novel 3D morphable model for complete human heads based on ...

0 Simon Giebenhain, et al. ∙

research

∙ 12/05/2022

ObjectMatch: Robust Registration using Canonical Object Correspondences

We present ObjectMatch, a semantic and object-centric camera pose estima...

0 Can Gümeli, et al. ∙

research

∙ 12/02/2022

ClipFace: Text-guided Editing of Textured 3D Morphable Models

We propose ClipFace, a novel self-supervised approach for text-guided ed...

0 Shivangi Aneja, et al. ∙

research

∙ 12/02/2022

DiffRF: Rendering-Guided 3D Radiance Field Diffusion

We introduce DiffRF, a novel approach for 3D radiance field synthesis ba...

0 Norman Müller, et al. ∙

research

∙ 11/25/2022

Neural Poisson: Indicator Functions for Neural Fields

Implicit neural field generating signed distance field representations (...

0 Angela Dai, et al. ∙

research

∙ 11/25/2022

Learning 3D Scene Priors with 2D Supervision

Holistic 3D scene understanding entails estimation of both layout config...

0 Yinyu Nie, et al. ∙

research

∙ 10/18/2022

How to Boost Face Recognition with StyleGAN?

State-of-the-art face recognition systems require huge amounts of labele...

1 Artem Sevastopolsky, et al. ∙

research

∙ 10/11/2022

The Unreasonable Effectiveness of Fully-Connected Layers for Low-Data Regimes

Convolutional neural networks were the standard for solving many compute...

0 Peter Kocsis, et al. ∙

research

∙ 10/11/2022

Neural Shape Deformation Priors

We present Neural Shape Deformation Priors, a novel method for shape man...

0 Jiapeng Tang, et al. ∙

research

∙ 06/28/2022

3D Multi-Object Tracking with Differentiable Pose Estimation

We propose a novel approach for joint 3D multi-object tracking and recon...

0 Dominik Schmauser, et al. ∙

research

∙ 05/30/2022

Fast Dynamic Radiance Fields with Time-Aware Neural Voxels

Neural radiance fields (NeRF) have shown great success in modeling 3D sc...

0 Jiemin Fang, et al. ∙

research

∙ 05/27/2022

3DILG: Irregular Latent Grids for 3D Generative Modeling

We propose a new representation for encoding 3D shapes as neural fields....

0 Biao Zhang, et al. ∙

research

∙ 05/03/2022

End2End Multi-View Feature Matching using Differentiable Pose Optimization

Learning-based approaches have become indispensable for camera pose esti...

25 Barbara Roessle, et al. ∙

research

∙ 04/07/2022

AutoRF: Learning 3D Object Radiance Fields from Single View Observations

We introduce AutoRF - a new approach for learning neural 3D object repre...

0 Norman Müller, et al. ∙

research

∙ 04/06/2022

Audio-Visual Person-of-Interest DeepFake Detection

Face manipulation technology is advancing very rapidly, and new methods ...

0 Davide Cozzolino, et al. ∙

research

∙ 04/05/2022

Texturify: Generating Textures on 3D Shape Surfaces

Texture cues on 3D objects are key to compelling visual representations,...

0 Yawar Siddiqui, et al. ∙

research

∙ 03/31/2022

3D Equivariant Graph Implicit Functions

In recent years, neural implicit representations have made remarkable pr...

6 Yunlu Chen, et al. ∙

research

∙ 12/06/2021

Dense Depth Priors for Neural Radiance Fields from Sparse Input Views

Neural radiance fields (NeRF) encode a scene into a neural representatio...

0 Barbara Roessle, et al. ∙

research

∙ 12/06/2021

4DContrast: Contrastive Learning with Dynamic Correspondences for 3D Scene Understanding

We present a new approach to instill 4D dynamic object priors into learn...

4 Yujin Chen, et al. ∙

research

∙ 12/03/2021

ROCA: Robust CAD Model Retrieval and Alignment from a Single Image

We present ROCA, a novel end-to-end approach that retrieves and aligns 3...

0 Can Gümeli, et al. ∙

research

∙ 12/02/2021

Neural Head Avatars from Monocular RGB Videos

We present Neural Head Avatars, a novel neural representation that expli...

0 Philip-William Grassal, et al. ∙

research

∙ 12/02/2021

StyleMesh: Style Transfer for Indoor 3D Scene Reconstructions

We apply style transfer on mesh reconstructions of indoor scenes. This e...

0 Lukas Höllein, et al. ∙

research

∙ 12/01/2021

Pose2Room: Understanding 3D Scenes from Human Activities

With wearable IMU sensors, one can estimate human poses from wearable de...

0 Yinyu Nie, et al. ∙

research

∙ 11/03/2021

Panoptic 3D Scene Reconstruction From a Single RGB Image

Understanding 3D scenes from a single image is fundamental to a wide var...

0 Manuel Dahnert, et al. ∙

research

∙ 07/07/2021

Egocentric Videoconferencing

We introduce a method for egocentric videoconferencing that enables hand...

2 Mohamed Elgharib, et al. ∙

research

∙ 07/05/2021

TransformerFusion: Monocular RGB Scene Reconstruction using Transformers

We introduce TransformerFusion, a transformer-based 3D scene reconstruct...

19 Aljaž Božič, et al. ∙

research

∙ 04/22/2021

Pri3D: Can 3D Priors Help 2D Representation Learning?

Recent advances in 3D perception have shown impressive progress in under...

8 Ji Hou, et al. ∙

research

∙ 04/09/2021

Neural RGB-D Surface Reconstruction

In this work, we explore how to leverage the success of implicit novel v...

6 Dejan Azinović, et al. ∙

research

∙ 04/08/2021

Dynamic Surface Function Networks for Clothed Human Bodies

We present a novel method for temporal coherent reconstruction and track...

31 Andrei Burov, et al. ∙

research

∙ 04/01/2021

NPMs: Neural Parametric Models for 3D Deformable Shapes

Parametric 3D models have enabled a wide variety of tasks in computer gr...

0 Pablo Palafox, et al. ∙

research

∙ 03/31/2021

RetrievalFuse: Neural 3D Scene Reconstruction with a Database

3D reconstruction of large scenes is a challenging problem due to the hi...

0 Yawar Siddiqui, et al. ∙

research

∙ 01/15/2021

Catching Out-of-Context Misinformation with Self-supervised Learning

Despite the recent attention to DeepFakes and other forms of image manip...

15 Shivangi Aneja, et al. ∙

research

∙ 12/17/2020

SceneFormer: Indoor Scene Generation with Transformers

The task of indoor scene generation is to generate a sequence of objects...

0 Xinpeng Wang, et al. ∙

research

∙ 12/16/2020

Exploring Data-Efficient 3D Scene Understanding with Contrastive Scene Contexts

The rapid progress in 3D scene understanding has come with growing deman...

10 Ji Hou, et al. ∙

research

∙ 12/15/2020

Seeing Behind Objects for 3D Multi-Object Tracking in RGB-D Sequences

Multi-object tracking from RGB-D video sequences is a challenging proble...

0 Norman Müller, et al. ∙

research

∙ 12/08/2020

Vid2CAD: CAD Model Alignment using Multi-View Constraints from Videos

We address the task of aligning CAD models to a video sequence of a comp...

13 Kevis-Kokitsi Maninis, et al. ∙

research

∙ 12/05/2020

Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstruction

We present dynamic neural radiance fields for modeling the appearance an...

35 Guy Gafni, et al. ∙

research

∙ 12/04/2020

ID-Reveal: Identity-aware DeepFake Video Detection

State-of-the-art DeepFake forgery detectors are trained in a supervised ...

0 Davide Cozzolino, et al. ∙

research

∙ 12/02/2020

Neural Deformation Graphs for Globally-consistent Non-rigid Reconstruction

We introduce Neural Deformation Graphs for globally-consistent deformati...

0 Aljaž Božič, et al. ∙

research

∙ 11/30/2020

RfD-Net: Point Scene Understanding by Semantic Instance Reconstruction

Semantic scene understanding from point clouds is particularly challengi...

0 Yinyu Nie, et al. ∙

research

∙ 07/29/2020

Face2Face: Real-time Face Capture and Reenactment of RGB Videos

We present Face2Face, a novel approach for real-time facial reenactment ...

6 Justus Thies, et al. ∙

research

∙ 06/29/2020

Intrinsic Autoencoders for Joint Neural Rendering and Intrinsic Image Decomposition

Neural rendering techniques promise efficient photo-realistic image synt...

10 Hassan Abu Alhaija, et al. ∙

Matthias Nießner

Featured Co-authors