research
∙
05/08/2023
HACK: Learning a Parametric Head and Neck Model for High-fidelity Animation
Significant advancements have been made in developing parametric models ...
share
research
∙
04/12/2023
InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactions
We have recently seen tremendous progress in diffusion advances for gene...
research
∙
04/10/2023
Neural Residual Radiance Fields for Streamably Free-Viewpoint Videos
The success of the Neural Radiance Fields (NeRFs) for modeling and free-...
research
∙
04/06/2023
Instant-NVR: Instant Neural Volumetric Rendering for Human-object Interactions from Monocular RGBD Stream
Convenient 4D modeling of human-object interactions is essential for num...
research
∙
03/31/2023
CIMI4D: A Large Multimodal Climbing Motion Dataset under Human-scene Interactions
Motion capture is a long-standing research problem. Although it has been...
research
∙
03/28/2023
CryoFormer: Continuous Reconstruction of 3D Structures from Cryo-EM Data using Transformer-based Neural Representations
High-resolution heterogeneous reconstruction of 3D structures of protein...
research
∙
03/16/2023
SLOPER4D: A Scene-Aware Dataset for Global 4D Human Pose Estimation in Urban Environments
We present SLOPER4D, a novel scene-aware dataset collected in large urba...
research
∙
02/02/2023
IKOL: Inverse kinematics optimization layer for 3D human pose and shape estimation via Gauss-Newton differentiation
This paper presents an inverse kinematic optimization layer (IKOL) for 3...
research
∙
12/15/2022
Relightable Neural Human Assets from Multi-view Gradient Illuminations
Human modeling and relighting are two fundamental problems in computer v...
research
∙
12/15/2022
NeuralDome: A Neural Modeling Pipeline on Multi-View Human-Object Interactions
Humans constantly interact with objects in daily life tasks. Capturing s...
research
∙
12/10/2022
HumanGen: Generating Human Radiance Fields with Explicit Priors
Recent years have witnessed the tremendous progress of 3D GANs for gener...
research
∙
11/30/2022
Weakly Supervised 3D Multi-person Pose Estimation for Large-scale Scenes based on Monocular Camera and Single LiDAR
Depth estimation is usually ill-posed and ambiguous for monocular camera...
research
∙
11/22/2022
LiCamGait: Gait Recognition in the Wild by Using LiDAR and Camera Multi-modal Visual Sensors
LiDAR can capture accurate depth information in large-scale scenarios wi...
research
∙
10/27/2022
Learning Variational Motion Prior for Video-based Motion Capture
Motion capture from a monocular video is fundamental and crucial for us ...
research
∙
09/14/2022
SCULPTOR: Skeleton-Consistent Face Creation Using a Learned Parametric Generator
Recent years have seen growing interest in 3D human faces modelling due ...
research
∙
07/16/2022
Mutual Adaptive Reasoning for Monocular 3D Multi-Person Pose Estimation
Inter-person occlusion and depth ambiguity make estimating the 3D poses ...
research
∙
07/03/2022
NARRATE: A Normal Assisted Free-View Portrait Stylizer
In this work, we propose NARRATE, a novel pipeline that enables simultan...
research
∙
05/30/2022
LiDAR-aid Inertial Poser: Large-scale Human Motion Capture by Sparse Inertial and LiDAR Sensors
We propose a multi-sensor fusion method for capturing challenging 3D hum...
research
∙
04/03/2022
STCrowd: A Multimodal Dataset for Pedestrian Perception in Crowded Scenes
Accurately detecting and tracking pedestrians in 3D space is challenging...
research
∙
03/28/2022
LiDARCap: Long-range Marker-less 3D Human Motion Capture with LiDAR Point Clouds
Existing motion capture datasets are largely short-range and cannot yet ...
research
∙
03/17/2022
HybridCap: Inertia-aid Monocular Capture of Challenging Human Motions
Monocular 3D motion capture (mocap) is beneficial to many applications. ...
research
∙
03/17/2022
HSC4D: Human-centered 4D Scene Capture in Large-scale Indoor-outdoor Space Using Wearable IMUs and LiDAR
We propose Human-centered 4D Scene Capture (HSC4D) to accurately and eff...
research
∙
03/08/2022
NeReF: Neural Refractive Field for Fluid Surface Reconstruction and Implicit Representation
Existing neural reconstruction schemes such as Neural Radiance Field (Ne...
research
∙
02/25/2022
NeuralFusion: Neural Volumetric Rendering under Human-object Interactions
4D modeling of human-object interactions is critical for numerous applic...
research
∙
02/12/2022
NeuVV: Neural Volumetric Videos with Immersive Rendering and Editing
Some of the most exciting experiences that Metaverse promises to offer, ...
research
∙
02/11/2022
Artemis: Articulated Neural Pets with Appearance and Motion synthesis
We, humans, are entering into a virtual era and indeed want to bring ani...
research
∙
02/11/2022
Video-driven Neural Physically-based Facial Asset for Production
Production-level workflows for producing convincing 3D dynamic human fac...
research
∙
02/09/2022
NIMBLE: A Non-rigid Hand Model with Bones and Muscles
Emerging Metaverse applications demand reliable, accurate, and photoreal...
research
∙
12/06/2021
HumanNeRF: Generalizable Neural Human Radiance Field from Sparse Inputs
Recent neural human representations can produce high-quality multi-view ...
research
∙
08/19/2021
Towards Controllable and Photorealistic Region-wise Image Manipulation
Adaptive and flexible image editing is a desirable function of modern ge...
research
∙
08/12/2021
iButter: Neural Interactive Bullet Time Generator for Human Free-viewpoint Rendering
Generating “bullet-time” effects of human free-viewpoint videos is criti...
research
∙
08/01/2021
Neural Free-Viewpoint Performance Rendering under Complex Human-object Interactions
4D reconstruction of human-object interaction is critical for immersive ...
research
∙
07/30/2021
Neural Relighting and Expression Transfer On Video Portraits
Photo-realistic video portrait reenactment benefits virtual production a...
research
∙
07/14/2021
Few-shot Neural Human Performance Rendering from Sparse RGBD Videos
Recent neural rendering approaches for human activities achieve remarkab...
research
∙
06/29/2021
IREM: High-Resolution Magnetic Resonance (MR) Image Reconstruction via Implicit Neural Representation
For collecting high-quality high-resolution (HR) MR image, we propose a ...
research
∙
06/21/2021
PIANO: A Parametric Hand Bone Model from Magnetic Resonance Imaging
Hand modeling is critical for immersive VR/AR, action understanding, or ...
research
∙
04/30/2021
RobustFusion: Robust Volumetric Performance Reconstruction under Human-object Interactions from Monocular RGBD Stream
High-quality 4D reconstruction of human performance with complex interac...
research
∙
04/30/2021
Editable Free-viewpoint Video Using a Layered Neural Representation
Generating free-viewpoint videos is critical for immersive VR/AR experie...
research
∙
04/23/2021
SportsCap: Monocular 3D Human Motion Capture and Fine-grained Understanding in Challenging Sports Videos
Markerless motion capture and understanding of professional non-daily hu...
research
∙
04/06/2021
MirrorNeRF: One-shot Neural Portrait RadianceField from Multi-mirror Catadioptric Imaging
Photo-realistic neural reconstruction and rendering of the human portrai...
research
∙
04/05/2021
Convolutional Neural Opacity Radiance Fields
Photo-realistic modeling and rendering of fuzzy objects with complex opa...
research
∙
04/01/2021
Neural Video Portrait Relighting in Real-time via Consistency Modeling
Video portraits relighting is critical in user-facing human photography,...
research
∙
03/29/2021
GNeRF: GAN-based Neural Radiance Field without Posed Camera
We introduce GNeRF, a framework to marry Generative Adversarial Networks...
research
∙
03/13/2021
NeuralHumanFVV: Real-Time Neural Volumetric Human Performance Rendering using RGB Cameras
4D reconstruction and rendering of human activities is critical for imme...
research
∙
03/11/2021
ChallenCap: Monocular 3D Capture of Challenging Human Performances using Multi-Modal References
Capturing challenging human motions is critical for numerous application...
research
∙
03/14/2020
OccuSeg: Occupancy-aware 3D Instance Segmentation
3D instance segmentation, with a variety of applications in robotics and...
research
∙
08/30/2019
EventCap: Monocular 3D Capture of High-Speed Human Motions using an Event Camera
The high frame rate is a critical requirement for capturing fast human m...
research
∙
09/18/2017
Beyond SIFT using Binary features for Loop Closure Detection
In this paper a binary feature based Loop Closure Detection (LCD) method...
research
∙
10/29/2016