research
∙
09/11/2023
SHIFT3D: Synthesizing Hard Inputs For Tricking 3D Detectors
We present SHIFT3D, a differentiable pipeline for generating 3D shapes t...
share
research
∙
07/11/2023
Objaverse-XL: A Universe of 10M+ 3D Objects
Natural language processing and 2D vision models have attained remarkabl...
research
∙
06/14/2023
ClimSim: An open large-scale dataset for training high-resolution physics emulators in hybrid multi-scale climate simulators
Modern climate projections lack adequate spatial and temporal resolution...
research
∙
05/24/2023
Sin3DM: Learning a Diffusion Model from a Single 3D Textured Shape
Synthesizing novel 3D models that resemble the input example has long be...
research
∙
05/04/2023
Tracking through Containers and Occluders in the Wild
Tracking objects with persistence in cluttered and dynamic environments ...
research
∙
05/02/2023
Humans as Light Bulbs: 3D Human Reconstruction from Thermal Reflection
The relatively hot temperature of the human body causes people to turn i...
research
∙
04/13/2023
SURFSUP: Learning Fluid Simulation for Novel Surfaces
Modeling the mechanics of fluid in complex scenes is vital to applicatio...
research
∙
03/20/2023
Zero-1-to-3: Zero-shot One Image to 3D Object
We introduce Zero-1-to-3, a framework for changing the camera viewpoint ...
research
∙
03/14/2023
ViperGPT: Visual Inference via Python Execution for Reasoning
Answering visual queries is a complex task that requires both visual pro...
research
∙
01/26/2023
Affective Faces for Goal-Driven Dyadic Communication
We introduce a video framework for modeling the association between verb...
research
∙
12/14/2022
Understanding Zero-Shot Adversarial Robustness for Large-Scale Models
Pretrained large-scale vision-language models like CLIP have exhibited s...
research
∙
12/13/2022
Adversarially Robust Video Perception by Seeing Motion
Despite their excellent performance, state-of-the-art computer vision mo...
research
∙
12/12/2022
Doubly Right Object Recognition: A Why Prompt for Visual Rationales
Many visual recognition models are evaluated only on their classificatio...
research
∙
12/12/2022
Robust Perception through Equivariance
Deep networks for computer vision are not reliable when they encounter a...
research
∙
12/08/2022
Task Bias in Vision-Language Models
Incidental supervision from language has become a popular approach for l...
research
∙
12/05/2022
Muscles in Action
Small differences in a person's motion can engage drastically different ...
research
∙
12/02/2022
Private Multiparty Perception for Navigation
We introduce a framework for navigating through cluttered environments b...
research
∙
11/21/2022
FLEX: Full-Body Grasping Without Full-Body Grasps
Synthesizing 3D human avatars interacting realistically with a scene is ...
research
∙
10/13/2022
Visual Classification via Description from Large Language Models
Vision-language models (VLMs) such as CLIP have shown promising performa...
research
∙
10/04/2022
Representing Spatial Trajectories as Distributions
We introduce a representation learning framework for spatial trajectorie...
research
∙
07/19/2022
Forget-me-not! Contrastive Critics for Mitigating Posterior Collapse
Variational autoencoders (VAEs) suffer from posterior collapse, where th...
research
∙
06/17/2022
Landscape Learning for Neural Network Inversion
Many machine learning methods operate by inverting a neural network at i...
research
∙
06/17/2022
Shadows Shed Light on 3D Objects
3D reconstruction is a fundamental problem in computer vision, and the t...
research
∙
06/14/2022
It's Time for Artistic Correspondence in Music and Video
We present an approach for recommending a music track for a given video,...
research
∙
04/26/2022
Causal Transportability for Visual Recognition
Visual representations underlie object recognition tasks, but they often...
research
∙
04/22/2022
Revealing Occlusions with 4D Neural Fields
For computer vision systems to operate in dynamic situations, they need ...
research
∙
03/01/2022
There is a Time and Place for Reasoning Beyond the Image
Images are often more significant than only the pixels to human eyes, as...
research
∙
12/14/2021
Real-Time Neural Voice Camouflage
Automatic speech recognition systems have created exciting possibilities...
research
∙
11/20/2021
Discrete Representations Strengthen Vision Transformer Robustness
Vision Transformer (ViT) is emerging as the state-of-the-art architectur...
research
∙
03/26/2021
Adversarial Attacks are Reversible with Natural Supervision
We find that images contain intrinsic structure that enables the reversa...
research
∙
01/01/2021
Learning the Predictability of the Future
We introduce a framework for learning from unlabeled video what is predi...
research
∙
12/22/2020
Generative Interventions for Causal Learning
We introduce a framework for learning robust visual representations that...
research
∙
12/08/2020
Globetrotter: Unsupervised Multilingual Translation from Visual Alignment
Multi-language machine translation without parallel corpora is challengi...
research
∙
11/24/2020
Dissecting Image Crops
The elementary operation of cropping underpins nearly every computer vis...
research
∙
10/22/2020
Listening to Sounds of Silence for Speech Denoising
We introduce a deep learning model for speech denoising, a long-standing...
research
∙
08/12/2020
We Have So Much In Common: Modeling Semantic Relational Set Abstractions in Videos
Identifying common patterns among events is a key ability in human and m...
research
∙
07/14/2020
Multitask Learning Strengthens Adversarial Robustness
Although deep networks achieve strong accuracy on a range of computer vi...
research
∙
06/28/2020
Video Representations of Goals Emerge from Watching Failure
We introduce a video representation learning framework that models the l...
research
∙
11/25/2019
Learning to Learn Words from Narrated Video
When we travel, we often encounter new scenarios we have never experienc...
research
∙
11/25/2019
Oops! Predicting Unintentional Action in Video
From just a short glance at a video, we can often tell whether a person'...
research
∙
10/15/2019
Visual Hide and Seek
We train embodied agents to play Visual Hide and Seek where a prey must ...
research
∙
09/03/2019
Metric Learning for Adversarial Robustness
Deep networks are well-known to be fragile to adversarial attacks. Using...
research
∙
04/08/2019
Relational Action Forecasting
This paper focuses on multi-person action forecasting in videos. More pr...
research
∙
04/03/2019
VideoBERT: A Joint Model for Video and Language Representation Learning
Self-supervised learning has become increasingly important to leverage t...
research
∙
11/28/2018
Multi-level Multimodal Common Semantic Space for Image-Phrase Grounding
We address the problem of phrase grounding by learning a multi-level com...
research
∙
08/13/2018
DeepBase: Deep Inspection of Neural Networks
Although deep learning models perform remarkably across a range of tasks...
research
∙
07/28/2018
Actor-Centric Relation Network
Current state-of-the-art approaches for spatio-temporal action localizat...
research
∙
06/25/2018
Tracking Emerges by Colorizing Videos
We use large amounts of unlabeled video to learn models for visual track...
research
∙
04/09/2018
The Sound of Pixels
We introduce PixelPlayer, a system that, by leveraging large amounts of ...
research
∙
01/09/2018