research
∙
09/14/2023
Language Embedded Radiance Fields for Zero-Shot Task-Oriented Grasping
Grasping objects by a specific part is often crucial for safety and for ...
share
research
∙
08/21/2023
Can Language Models Learn to Listen?
We present a framework for generating appropriate facial responses from ...
research
∙
07/11/2023
Differentiable Blocks World: Qualitative 3D Decomposition by Rendering Primitives
Given a set of calibrated images of a scene, we present an approach that...
research
∙
06/15/2023
Generative Proxemics: A Prior for 3D Social Interaction from Images
Social interaction is a fundamental aspect of human behavior and communi...
research
∙
05/31/2023
Humans in 4D: Reconstructing and Tracking Humans with Transformers
We present an approach to reconstruct humans and track them over time. A...
research
∙
05/08/2023
NerfAcc: Efficient Sampling Accelerates NeRFs
Optimizing and rendering Neural Radiance Fields is computationally expen...
research
∙
04/20/2023
Nerfbusters: Removing Ghostly Artifacts from Casually Captured NeRFs
Casually captured Neural Radiance Fields (NeRFs) suffer from artifacts s...
research
∙
04/04/2023
Generating Continual Human Motion in Diverse 3D Scenes
We introduce a method to synthesize animator guided human motion across ...
research
∙
04/03/2023
On the Benefits of 3D Pose and Tracking for Human Action Recognition
In this work we study the benefits of using tracking and 3D poses for ac...
research
∙
03/22/2023
Instruct-NeRF2NeRF: Editing 3D Scenes with Instructions
We propose a method for editing NeRF scenes with text-instructions. Give...
research
∙
03/16/2023
LERF: Language Embedded Radiance Fields
Humans describe the physical world using natural language to refer to sp...
research
∙
02/24/2023
Decoupling Human and Camera Motion from Videos in the Wild
We propose a method to reconstruct global human trajectories from videos...
research
∙
02/08/2023
Nerfstudio: A Modular Framework for Neural Radiance Field Development
Neural Radiance Fields (NeRF) are a rapidly growing area of research wit...
research
∙
01/24/2023
K-Planes: Explicit Radiance Fields in Space, Time, and Appearance
We introduce k-planes, a white-box model for radiance fields in arbitrar...
research
∙
10/24/2022
Monocular Dynamic View Synthesis: A Reality Check
We study the recent progress on dynamic view synthesis (DVS) from monocu...
research
∙
10/10/2022
NerfAcc: A General NeRF Acceleration Toolbox
We propose NerfAcc, a toolbox for efficient volumetric rendering of radi...
research
∙
09/06/2022
Studying Bias in GANs through the Lens of Race
In this work, we study how the performance and evaluation of generative ...
research
∙
07/28/2022
The One Where They Reconstructed 3D Humans and Environments in TV Shows
TV shows depict a wide variety of human behaviors and have been studied ...
research
∙
07/22/2022
InfiniteNature-Zero: Learning Perpetual View Generation of Natural Scenes from Single Images
We present a method for learning to generate unbounded flythrough videos...
research
∙
06/21/2022
Domain Adaptive 3D Pose Augmentation for In-the-wild Human Mesh Recovery
The ability to perceive 3D human bodies from a single image has a multit...
research
∙
06/17/2022
TAVA: Template-free Animatable Volumetric Actors
Coordinate-based volumetric representations have the potential to genera...
research
∙
04/18/2022
Learning to Listen: Modeling Non-Deterministic Dyadic Facial Motion
We present a framework for modeling interactional communication in dyadi...
research
∙
04/14/2022
Deformable Sprites for Unsupervised Video Decomposition
We describe a method to extract persistent elements of a dynamic scene f...
research
∙
12/09/2021
Plenoxels: Radiance Fields without Neural Networks
We introduce Plenoxels (plenoptic voxels), a system for photorealistic v...
research
∙
12/08/2021
Tracking People by Predicting 3D Appearance, Location Pose
In this paper, we present an approach for tracking people in monocular v...
research
∙
11/15/2021
Tracking People with 3D Representations
We present a novel approach for tracking multiple people in video. Unlik...
research
∙
04/22/2021
KeypointDeformer: Unsupervised 3D Keypoint Discovery for Shape Control
We introduce KeypointDeformer, a novel unsupervised method for shape con...
research
∙
04/08/2021
De-rendering the World's Revolutionary Artefacts
Recent works have shown exciting results in unsupervised image de-render...
research
∙
04/05/2021
AMP: Adversarial Motion Priors for Stylized Physics-Based Character Control
Synthesizing graceful and life-like behaviors for physically simulated c...
research
∙
03/25/2021
PlenOctrees for Real-time Rendering of Neural Radiance Fields
We introduce a method to render Neural Radiance Fields (NeRFs) in real t...
research
∙
01/21/2021
Learn to Dance with AIST++: Music Conditioned 3D Dance Generation
In this paper, we present a transformer-based learning framework for 3D ...
research
∙
12/17/2020
Reconstructing Hand-Object Interactions in the Wild
In this work we explore reconstructing hand-object interactions in the w...
research
∙
12/17/2020
Infinite Nature: Perpetual View Generation of Natural Scenes from a Single Image
We introduce the problem of perpetual view generation – long-range gener...
research
∙
12/17/2020
Human Mesh Recovery from Multiple Shots
Videos from edited media like movies are a useful, yet under-explored so...
research
∙
12/03/2020
pixelNeRF: Neural Radiance Fields from One or Few Images
We propose pixelNeRF, a learning framework that predicts a continuous ne...
research
∙
07/30/2020
Perceiving 3D Human-Object Spatial Arrangements from a Single Image in the Wild
We present a method that infers spatial arrangements and shapes of human...
research
∙
07/21/2020
Shape and Viewpoint without Keypoints
We present a learning framework that learns to recover the 3D shape, pos...
research
∙
06/25/2020
An Analysis of SVD for Deep Rotation Estimation
Symmetric orthogonalization via SVD, and closely related procedures, are...
research
∙
08/20/2019
Three-D Safari: Learning to Estimate Zebra Pose, Shape, and Texture from Images "In the Wild"
We present the first method to perform automatic 3D pose, shape and text...
research
∙
08/13/2019
Predicting 3D Human Dynamics from Video
Given a video of a person in action, we can easily guess the 3D future m...
research
∙
05/13/2019
PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitization
We introduce Pixel-aligned Implicit Function (PIFu), a highly effective ...
research
∙
12/04/2018
Learning 3D Human Dynamics from Video
From an image of a person in action, we can easily guess the 3D motion o...
research
∙
10/08/2018
SFV: Reinforcement Learning of Physical Skills from Videos
Data-driven character animation based on motion capture can produce high...
research
∙
10/01/2018
Variational Discriminator Bottleneck: Improving Imitation Learning, Inverse RL, and GANs by Constraining Information Flow
Adversarial learning methods have been proposed for a wide range of appl...
research
∙
03/20/2018
Learning Category-Specific Mesh Reconstruction from Image Collections
We present a learning framework for recovering the 3D shape, camera, and...
research
∙
12/18/2017
End-to-end Recovery of Human Shape and Pose
We describe Human Mesh Recovery (HMR), an end-to-end framework for recon...
research
∙
12/02/2017
SfSNet : Learning Shape, Reflectance and Illuminance of Faces in the Wild
We present SfSNet, an end-to-end learning framework for producing an acc...
research
∙
07/24/2017
Towards Accurate Markerless Human Shape and Pose Estimation over Time
Existing marker-less motion capture methods often assume known backgroun...
research
∙
11/23/2016
3D Menagerie: Modeling the 3D shape and pose of animals
There has been significant work on learning realistic, articulated, 3D m...
research
∙
07/27/2016