Gordon Wetzstein

research

∙ 09/04/2023

Instant Continual Learning of Neural Radiance Fields

Neural radiance fields (NeRFs) have emerged as an effective method for n...

0 Ryan Po, et al. ∙

research

∙ 07/27/2023

PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Tracking

We introduce PointOdyssey, a large-scale synthetic dataset, and data gen...

0 Yang Zheng, et al. ∙

research

∙ 07/11/2023

Efficient 3D Articulated Human Generation with Layered Surface Volumes

Access to high-quality and diverse 3D articulated digital human assets i...

0 Yinghao Xu, et al. ∙

research

∙ 07/10/2023

Articulated 3D Head Avatar Generation using Text-to-Image Diffusion Models

The ability to generate diverse 3D articulated head avatars is vital to ...

0 Alexander W. Bergman, et al. ∙

research

∙ 05/04/2023

Single-Shot Implicit Morphable Faces with Consistent Texture Parameterization

There is a growing demand for the accessible creation of high-quality 3D...

3 Connor Z. Lin, et al. ∙

research

∙ 05/01/2023

Learning Controllable Adaptive Simulation for Multi-resolution Physics

Simulating the time evolution of physical systems is pivotal in many sci...

0 Tailin Wu, et al. ∙

research

∙ 04/11/2023

PixelRNN: In-pixel Recurrent Neural Networks for End-to-end-optimized Perception with Neural Sensors

Conventional image sensors digitize high-resolution images at fast frame...

0 Haley M. So, et al. ∙

research

∙ 04/05/2023

Generative Novel View Synthesis with 3D-Aware Diffusion Models

We present a diffusion-based model for 3D-aware generative novel view sy...

0 Eric R. Chan, et al. ∙

research

∙ 03/21/2023

Compositional 3D Scene Generation using Locally Conditioned Diffusion

Designing complex 3D scenes has been a tedious, manual process requiring...

0 Ryan Po, et al. ∙

research

∙ 03/21/2023

CC3D: Layout-Conditioned Generation of Compositional 3D Scenes

In this work, we introduce CC3D, a conditional generative model that syn...

0 Sherwin Bahmani, et al. ∙

research

∙ 03/20/2023

DehazeNeRF: Multiple Image Haze Removal and 3D Shape Reconstruction using Neural Radiance Fields

Neural radiance fields (NeRFs) have demonstrated state-of-the-art perfor...

0 Wei-Ting Chen, et al. ∙

research

∙ 03/14/2023

MELON: NeRF with Unposed Images Using Equivalence Class Estimation

Neural radiance fields enable novel-view synthesis and scene reconstruct...

0 Axel Levy, et al. ∙

research

∙ 03/07/2023

Diffusion in the Dark: A Diffusion Model for Low-Light Text Recognition

Images are indispensable for the automation of high-level tasks, such as...

0 Cindy M. Nguyen, et al. ∙

research

∙ 02/02/2023

Towards Attention-aware Rendering for Virtual and Augmented Reality

Foveated graphics is a promising approach to solving the bandwidth chall...

0 Brooke Krajancich, et al. ∙

research

∙ 12/21/2022

PaletteNeRF: Palette-based Appearance Editing of Neural Radiance Fields

Recent advances in neural radiance fields have enabled the high-fidelity...

0 Zhengfei Kuang, et al. ∙

research

∙ 12/16/2022

PointAvatar: Deformable Point-based Head Avatars from Videos

The ability to create realistic, animatable and relightable head avatars...

0 Yufeng Zheng, et al. ∙

research

∙ 12/08/2022

ALTO: Alternating Latent Topologies for Implicit 3D Reconstruction

This work introduces alternating latent topologies (ALTO) for high-fidel...

0 Zhen Wang, et al. ∙

research

∙ 11/30/2022

SinGRAF: Learning a 3D Generative Radiance Field for a Single Scene

Generative models have shown great promise in synthesizing photorealisti...

0 Minjung Son, et al. ∙

research

∙ 11/22/2022

DiffDreamer: Consistent Single-view Perpetual View Generation with Conditional Diffusion Models

Perpetual view generation – the task of generating long-range novel view...

0 Shengqu Cai, et al. ∙

research

∙ 10/13/2022

Amortized Inference for Heterogeneous Reconstruction in Cryo-EM

Cryo-electron microscopy (cryo-EM) is an imaging modality that provides ...

0 Axel Levy, et al. ∙

research

∙ 09/29/2022

Heterogeneous reconstruction of deformable atomic models in Cryo-EM

Cryogenic electron microscopy (cryo-EM) provides a unique opportunity to...

0 Youssef Nashed, et al. ∙

research

∙ 07/18/2022

NeuForm: Adaptive Overfitting for Neural Shape Editing

Neural representations are popular for representing shapes, as they can ...

25 Connor Z. Lin, et al. ∙

research

∙ 06/29/2022

3D-Aware Video Generation

Generative models have emerged as an essential building block for many i...

21 Sherwin Bahmani, et al. ∙

research

∙ 06/01/2022

Learning to Solve PDE-constrained Inverse Problems with Graph Networks

Learned graph neural networks (GNNs) have recently been established as f...

0 Qingqing Zhao, et al. ∙

research

∙ 05/05/2022

Time-multiplexed Neural Holography: A flexible framework for holographic near-eye displays with fast heavily-quantized spatial light modulators

Holographic near-eye displays offer unprecedented capabilities for virtu...

0 Suyeon Choi, et al. ∙

research

∙ 04/14/2022

Learning Spatially Varying Pixel Exposures for Motion Deblurring

Computationally removing the motion blur introduced by camera shake or o...

0 Cindy M. Nguyen, et al. ∙

research

∙ 03/25/2022

3D GAN Inversion for Controllable Portrait Image Animation

Millions of images of human faces are captured every single day; but the...

0 Connor Z. Lin, et al. ∙

research

∙ 03/15/2022

CryoAI: Amortized Inference of Poses for Ab Initio Reconstruction of 3D Molecular Volumes from Real Cryo-EM Images

Cryo-electron microscopy (cryo-EM) has become a tool of fundamental impo...

0 Axel Levy, et al. ∙

research

∙ 12/15/2021

Efficient Geometry-aware 3D Generative Adversarial Networks

Unsupervised generation of high-quality multi-view-consistent images and...

9 Eric R. Chan, et al. ∙

research

∙ 12/09/2021

MantissaCam: Learning Snapshot High-dynamic-range Imaging with Perceptually-based In-pixel Irradiance Encoding

The ability to image high-dynamic-range (HDR) scenes is crucial in many ...

4 Haley M. So, et al. ∙

research

∙ 12/09/2021

BACON: Band-limited Coordinate Networks for Multiscale Scene Representation

Coordinate-based networks have emerged as a powerful tool for 3D represe...

0 David B. Lindell, et al. ∙

research

∙ 08/28/2021

Towards Retina-Quality VR Video Streaming: 15ms Could Save You 80 Your Bandwidth

Virtual reality systems today cannot yet stream immersive, retina-qualit...

0 Luke Hsiao, et al. ∙

research

∙ 06/28/2021

Fast Training of Neural Lumigraph Representations using Meta Learning

Novel view synthesis is a long-standing problem in machine learning and ...

5 Alexander W. Bergman, et al. ∙

research

∙ 05/06/2021

ACORN: Adaptive Coordinate Networks for Neural Scene Representation

Neural representations have emerged as a new paradigm for applications i...

10 Julien N. P. Martel, et al. ∙

research

∙ 04/28/2021

A Perceptual Model for Eccentricity-dependent Spatio-temporal Flicker Fusion and its Applications to Foveated Graphics

Virtual and augmented reality (VR/AR) displays strive to provide a resol...

0 Brooke Krajancich, et al. ∙

research

∙ 04/06/2021

Time-Multiplexed Coded Aperture Imaging: Learned Coded Aperture and Pixel Exposures for Compressive Imaging Systems

Compressive imaging using coded apertures (CA) is a powerful technique t...

0 Edwin Vargas, et al. ∙

research

∙ 03/25/2021

ScanGAN360: A Generative Model of Realistic Scanpaths for 360^∘ Images

Understanding and modeling the dynamics of human gaze behavior in 360^∘ ...

0 Daniel Martin, et al. ∙

research

∙ 03/22/2021

Neural Lumigraph Rendering

Novel view synthesis is a challenging and ill-posed inverse rendering pr...

0 Petr Kellnhofer, et al. ∙

research

∙ 12/03/2020

AutoInt: Automatic Integration for Fast Neural Volume Rendering

Numerical integration is a foundational technique in scientific computin...

0 David B. Lindell, et al. ∙

research

∙ 12/02/2020

pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesis

We have witnessed rapid progress on 3D-aware image synthesis, leveraging...

14 Eric R. Chan, et al. ∙

research

∙ 10/25/2020

SUREMap: Predicting Uncertainty in CNN-based Image Reconstruction Using Stein's Unbiased Risk Estimate

Convolutional neural networks (CNN) have emerged as a powerful tool for ...

0 Ruangrawee Kitichotkul, et al. ∙

research

∙ 09/19/2020

Michelson Holography: Dual-SLM Holography with Camera-in-the-loop Optimization

We introduce Michelson Holography (MH), a holographic display technology...

0 Suyeon Choi, et al. ∙

research

∙ 09/01/2020

End-to-End Hyperspectral-Depth Imaging with Learned Diffractive Optics

To extend the capabilities of spectral imaging, hyperspectral and depth ...

32 Seung-Hwan Baek, et al. ∙

research

∙ 06/17/2020

MetaSDF: Meta-learning Signed Distance Functions

Neural implicit shape representations are an emerging paradigm that offe...

0 Vincent Sitzmann, et al. ∙

research

∙ 06/17/2020

Implicit Neural Representations with Periodic Activation Functions

Implicitly defined, continuous, differentiable signal representations pa...

16 Vincent Sitzmann, et al. ∙

research

∙ 04/08/2020

State of the Art on Neural Rendering

Efficient rendering of photo-realistic virtual worlds is a long standing...

13 Ayush Tewari, et al. ∙

research

∙ 04/07/2020

Event Based, Near Eye Gaze Tracking Beyond 10,000Hz

Fast and accurate eye tracking is crucial for many applications. Current...

0 Anastasios N. Angelopoulos, et al. ∙

research

∙ 03/28/2020

Inferring Semantic Information with 3D Neural Scene Representations

Biological vision infers multi-modal 3D representations that support rea...

0 Amit Kohli, et al. ∙

research

∙ 02/14/2020

Deep S^3PR: Simultaneous Source Separation and Phase Retrieval Using Deep Generative Models

This paper introduces and solves the simultaneous source separation and ...

0 Christopher A. Metzler, et al. ∙

research

∙ 12/13/2019

Keyhole Imaging: Non-Line-of-Sight Imaging and Tracking of Moving Objects Along a Single Optical Path at Long Standoff Distances

Non-line-of-sight (NLOS) imaging and tracking is an emerging paradigm th...

26 Christopher A. Metzler, et al. ∙

Gordon Wetzstein

Featured Co-authors