research
∙
09/11/2023
Blendshapes GHUM: Real-time Monocular Facial Blendshape Prediction
We present Blendshapes GHUM, an on-device ML pipeline that predicts 52 f...
share
research
∙
08/03/2023
Reconstructing Three-Dimensional Models of Interacting Humans
Understanding 3d human interactions is fundamental for fine-grained scen...
research
∙
06/15/2023
DreamHuman: Animatable 3D Avatars from Text
We present DreamHuman, a method to generate realistic animatable 3D huma...
research
∙
12/15/2022
HUM3DIL: Semi-supervised Multi-modal 3D Human Pose Estimation for Autonomous Driving
Autonomous driving is an exciting new industry, posing important researc...
research
∙
12/14/2022
PhoMoH: Implicit Photorealistic 3D Models of Human Heads
We present PhoMoH, a neural network methodology to construct generative ...
research
∙
12/13/2022
Structured 3D Features for Reconstructing Relightable and Animatable Avatars
We introduce Structured 3D Features, a model based on a novel implicit 3...
research
∙
12/02/2022
Transformer-Based Learned Optimization
In this paper, we propose a new approach to learned optimization. As com...
research
∙
06/23/2022
BlazePose GHUM Holistic: Real-time 3D Human Landmarks and Pose Estimation
We present BlazePose GHUM Holistic, a lightweight neural network pipelin...
research
∙
05/24/2022
Trajectory Optimization for Physics-Based Reconstruction of 3d Human Pose from Monocular Video
We focus on the task of estimating a physically plausible articulated hu...
research
∙
05/24/2022
Differentiable Dynamics for Articulated 3d Human Motion Reconstruction
We introduce DiffPhy, a differentiable physics-based model for articulat...
research
∙
04/19/2022
Photorealistic Monocular 3D Reconstruction of Humans Wearing Clothing
We present PHORHUM, a novel, end-to-end trainable, deep neural network m...
research
∙
04/14/2022
BEHAVE: Dataset and Method for Tracking Human Object Interactions
Modelling interactions between humans and objects in natural environment...
research
∙
04/07/2022
Learning Online Multi-Sensor Depth Fusion
Many hand-held or mixed reality devices are used with a single sensor fo...
research
∙
03/02/2022
Discriminating Against Unrealistic Interpolations in Generative Adversarial Networks
Interpolations in the latent space of deep generative models is one of t...
research
∙
12/28/2021
Embodied Learning for Lifelong Visual Perception
We study lifelong visual perception in an embodied setup, where we devel...
research
∙
12/23/2021
HSPACE: Synthetic Parametric Humans Animated in Complex Environments
Advances in the state of the art for 3d human sensing are currently limi...
research
∙
10/26/2021
H-NeRF: Neural Radiance Fields for Rendering and Temporal Reconstruction of Humans in Motion
We present H-NeRF, neural radiance fields for rendering and temporal (4D...
research
∙
08/24/2021
imGHUM: Implicit Generative Models of 3D Human Shape and Articulated Pose
We present imGHUM, the first holistic generative model of 3D human shape...
research
∙
08/11/2021
A Real-Time Online Learning Framework for Joint 3D Reconstruction and Semantic Segmentation of Indoor Scenes
This paper presents a real-time online vision framework to jointly recov...
research
∙
06/17/2021
THUNDR: Transformer-based 3D HUmaN Reconstruction with Markers
We present THUNDR, a transformer-based deep neural network methodology t...
research
∙
04/06/2021
Local Metrics for Multi-Object Tracking
This paper introduces temporally local metrics for Multi-Object Tracking...
research
∙
12/18/2020
Learning Complex 3D Human Self-Contact
Monocular estimation of three dimensional human self-contact is fundamen...
research
∙
12/17/2020
Embodied Visual Active Learning for Semantic Segmentation
We study the task of embodied visual active learning, where an agent is ...
research
∙
10/23/2020
LoopReg: Self-supervised Learning of Implicit Surface Correspondences, Pose and Shape for 3D Human Mesh Registration
We address the problem of fitting 3D human models to 3D scans of dressed...
research
∙
08/16/2020
Neural Descent for Visual 3D Human Pose and Shape
We present deep neural network methodology to reconstruct the 3d pose an...
research
∙
07/22/2020
Combining Implicit Function Learning and Parametric Models for 3D Human Reconstruction
Implicit functions represented as deep learning approximations are power...
research
∙
06/23/2020
Post-hoc Calibration of Neural Networks
Calibration of neural networks is a critical aspect to consider when inc...
research
∙
06/23/2020
Calibration of Neural Networks using Splines
Calibrating neural networks is of utmost importance when employing them ...
research
∙
06/19/2020
Consistency Guided Scene Flow Estimation
We present Consistency Guided Scene Flow Estimation (CGSF), a framework ...
research
∙
05/20/2020
Range Conditioned Dilated Convolutions for Scale Invariant 3D Object Detection
This paper presents a novel 3D object detection framework that processes...
research
∙
03/23/2020
Weakly Supervised 3D Human Pose and Shape Reconstruction with Normalizing Flows
Monocular 3D human pose and shape estimation is challenging due to the m...
research
∙
01/07/2020
Deep Reinforcement Learning for Active Human Pose Estimation
Most 3d human pose estimation methods assume that input – be it images o...
research
∙
01/03/2020
Feature-Robustness, Flatness and Generalization Error for Deep Neural Networks
The performance of deep neural networks is often attributed to their aut...
research
∙
11/29/2019
A Reparameterization-Invariant Flatness Measure for Deep Neural Networks
The performance of deep neural networks is often attributed to their aut...
research
∙
09/23/2019
Human Synthesis and Scene Compositing
Generating good quality and geometrically plausible synthetic images of ...
research
∙
07/12/2019
Self-supervised Learning with Geometric Constraints in Monocular Video: Connecting Flow, Depth, and Camera
We present GLNet, a self-supervised framework for learning depth, optica...
research
∙
12/16/2018
Non-attracting Regions of Local Minima in Deep and Wide Neural Networks
Understanding the loss surface of neural networks is essential for the d...
research
∙
01/31/2017
Deep Multitask Architecture for Integrated 2D and 3D Human Sensing
We propose a deep multitask architecture for fully automatic 2d and 3d h...
research
∙
12/28/2016
Semantic Video Segmentation by Gated Recurrent Flow Propagation
Semantic video segmentation is challenging due to the sheer amount of da...
research
∙
10/17/2016
Spatio-Temporal Attention Models for Grounded Video Captioning
Automatic video captioning is challenging due to the complex interaction...
research
∙
09/25/2015
Training Deep Networks with Structured Layers by Matrix Backpropagation
Deep neural network architectures have recently produced excellent resul...
research
∙
02/05/2015
A Framework for Symmetric Part Detection in Cluttered Scenes
The role of symmetry in computer vision has waxed and waned in importanc...
research
∙
01/27/2015
Parametric Image Segmentation of Humans with Structural Shape Priors
The figure-ground segmentation of humans in images captured in natural e...
research
∙
11/29/2014
Multiple Instance Reinforcement Learning for Efficient Weakly-Supervised Detection in Images
State-of-the-art visual recognition and detection systems increasingly r...
research
∙
12/30/2013
Constrained Parametric Proposals and Pooling Methods for Semantic Segmentation in RGB-D Images
We focus on the problem of semantic segmentation based on RGB-D data, wi...
research
∙
12/29/2013
Actions in the Eye: Dynamic Gaze Datasets and Learnt Saliency Models for Visual Recognition
Systems based on bag-of-words models from image features collected at ma...
research
∙
06/18/2012
A Linear Approximation to the chi^2 Kernel with Geometric Convergence
We propose a new analytical approximation to the χ^2 kernel that converg...
research
∙
09/24/2010