research
∙
09/14/2023
OmnimatteRF: Robust Omnimatte with 3D Background Modeling
Video matting has broad applications, from adding interesting effects to...
share
research
∙
05/03/2023
Inverse Global Illumination using a Neural Radiometric Prior
Inverse rendering methods that account for global illumination are becom...
research
∙
03/25/2023
PAniC-3D: Stylized Single-view 3D Reconstruction from Portraits of Anime Characters
We propose PAniC-3D, a system to reconstruct stylized 3D character heads...
research
∙
04/23/2022
Surface Reconstruction from Point Clouds by Learning Predictive Context Priors
Surface reconstruction from point clouds is vital for 3D computer vision...
research
∙
01/31/2022
Differentiable Neural Radiosity
We introduce Differentiable Neural Radiosity, a novel method of represen...
research
∙
12/19/2021
HVTR: Hybrid Volumetric-Textural Rendering for Human Avatars
We propose a novel neural rendering pipeline, Hybrid Volumetric-Textural...
research
∙
11/24/2021
Improving the Perceptual Quality of 2D Animation Interpolation
Traditional 2D animation is labor-intensive, often requiring animators t...
research
∙
11/24/2021
EgoRenderer: Rendering Human Avatars from Egocentric Camera Images
We present EgoRenderer, a system for rendering full-body neural avatars ...
research
∙
11/02/2021
PatchGame: Learning to Signal Mid-level Patches in Referential Games
We study a referential game (a type of signaling game) where two agents ...
research
∙
08/08/2021
Unsupervised Learning of Fine Structure Generation for 3D Point Clouds by 2D Projection Matching
Learning to generate 3D point clouds without 3D supervision is an import...
research
∙
08/08/2021
Hierarchical View Predictor: Unsupervised 3D Global Feature Learning through Hierarchical Prediction among Unordered Views
Unsupervised learning of global features for 3D shape analysis is an imp...
research
∙
08/04/2021
Transfer Learning for Pose Estimation of Illustrated Characters
Human pose information is a critical component in many downstream image ...
research
∙
05/26/2021
Neural Radiosity
We introduce Neural Radiosity, an algorithm to solve the rendering equat...
research
∙
12/14/2020
Continuous Curve Textures
Repetitive patterns are ubiquitous in natural and human-made objects, an...
research
∙
11/26/2020
Neural-Pull: Learning Signed Distance Functions from Point Clouds by Learning to Pull Space onto Surfaces
Reconstructing continuous surfaces from 3D point clouds is a fundamental...
research
∙
09/07/2020
Improved Modeling of 3D Shapes with Multi-view Depth Maps
We present a simple yet effective general-purpose framework for modeling...
research
∙
07/12/2020
DRWR: A Differentiable Renderer without Rendering for Unsupervised 3D Structure Learning from Silhouette Images
Differentiable renderers have been used successfully for unsupervised 3D...
research
∙
05/26/2020
Fine-Grained 3D Shape Classification with Hierarchical Part-View Attentions
Fine-grained 3D shape classification is important and research challengi...
research
∙
03/18/2020
LRC-Net: Learning Discriminative Features on Point Clouds by Encoding Local Region Contexts
Learning discriminative feature directly on point clouds is still challe...
research
∙
03/18/2020
LRC-Net: Learning Discriminative Features on Point Clouds by EncodingLocal Region Contexts
Learning discriminative feature directly on point clouds is still challe...
research
∙
03/12/2020
SeqXY2SeqZ: Structure Learning for 3D Shapes by Sequentially Predicting 1D Occupancy Segments From 2D Coordinates
Structure learning for 3D shapes is vital for 3D computer vision. State-...
research
∙
02/23/2020
ORCSolver: An Efficient Solver for Adaptive GUI Layout with OR-Constraints
OR-constrained (ORC) graphical user interface layouts unify conventional...
research
∙
01/08/2020
Learning Generative Models using Denoising Density Estimators
Learning generative probabilistic models that can estimate the continuou...
research
∙
12/22/2019
Learning to Generate Dense Point Clouds with Textures on Multiple Categories
3D reconstruction from images is a core problem in computer vision. With...
research
∙
12/15/2019
SDFDiff: Differentiable Rendering of Signed Distance Fields for 3D Shape Optimization
We propose SDFDiff, a novel approach for image-based shape optimization ...
research
∙
11/28/2019
3D Shape Completion with Multi-view Consistent Inference
3D shape completion is important to enable machines to perceive the comp...
research
∙
08/02/2019
L2G Auto-encoder: Understanding Point Clouds by Local-to-Global Reconstruction with Hierarchical Self-Attention
Auto-encoder is an important architecture to understand point clouds in ...
research
∙
07/31/2019
ShapeCaptioner: Generative Caption Network for 3D Shapes by Learning a Mapping from Parts Detected in Multiple Views to Sentences
3D shape captioning is a challenging application in 3D shape understandi...
research
∙
07/30/2019
Multi-Angle Point Cloud-VAE: Unsupervised Feature Learning for 3D Point Clouds from Multiple Angles by Joint Self-Reconstruction and Half-to-Half Prediction
Unsupervised feature learning for point clouds has been vital for large-...
research
∙
05/18/2019
Parts4Feature: Learning 3D Global Features from Generally Semantic Parts in Multiple Views
Deep learning has achieved remarkable results in 3D shape analysis by le...
research
∙
05/17/2019
3DViewGraph: Learning Global Features for 3D Shapes from A Graph of Unordered Views with Attention
Learning global features by aggregating information over multiple views ...
research
∙
04/17/2019
Render4Completion: Synthesizing Multi-view Depth Maps for 3D Shape Completion
We propose a novel approach for 3D shape completion by synthesizing mult...
research
∙
03/15/2019
Smart, Deep Copy-Paste
In this work, we propose a novel system for smart copy-paste, enabling t...
research
∙
01/06/2019
Understanding the (un)interpretability of natural image distributions using generative models
Probability density estimation is a classical and well studied problem, ...
research
∙
12/05/2018
Video Synthesis from a Single Image and Motion Stroke
In this paper, we propose a new method to automatically generate a video...
research
∙
11/07/2018
Y^2Seq2Seq: Cross-Modal Representation Learning for 3D Shape and Text by Joint Reconstruction and Prediction of View and Word Sequences
A recent method employs 3D voxels to represent 3D shapes, but this limit...
research
∙
11/07/2018
View Inter-Prediction GAN: Unsupervised Representation Learning for 3D Shapes by Learning Global Shape Memories to Support Local View Predictions
In this paper we present a novel unsupervised representation learning ap...
research
∙
11/06/2018
Point2Sequence: Learning the Shape Representation of 3D Point Clouds with an Attention-based Sequence to Sequence Network
Exploring contextual information in the local region is important for sh...
research
∙
08/23/2018
Learning to Importance Sample in Primary Sample Space
Importance sampling is one of the most widely used variance reduction st...
research
∙
07/14/2018
Specular-to-Diffuse Translation for Multi-View Reconstruction
Most multi-view 3D reconstruction algorithms, especially when shape-from...
research
∙
04/24/2018
FaceShop: Deep Sketch-based Face Image Editing
We present a novel system for sketch-based face image editing, enabling ...
research
∙
11/20/2017
Disentangling Factors of Variation by Mixing Them
We propose an unsupervised approach to learn image representations that ...
research
∙
11/07/2017
Challenges in Disentangling Independent Factors of Variation
We study the problem of building models that disentangle independent fac...
research
∙
09/12/2017
Deep Mean-Shift Priors for Image Restoration
In this paper we introduce a natural image prior that directly represent...
research
∙
03/29/2017
Image Restoration using Autoencoding Priors
We propose to leverage denoising autoencoder networks as priors to addre...
research
∙
08/16/2016