research
∙
08/28/2023
VideoCutLER: Surprisingly Simple Unsupervised Video Instance Segmentation
Existing approaches to unsupervised video instance segmentation typicall...
share
research
∙
08/21/2023
Can Language Models Learn to Listen?
We present a framework for generating appropriate facial responses from ...
research
∙
07/31/2023
Predicting masked tokens in stochastic locations improves masked image modeling
Self-supervised learning is a promising paradigm in deep learning that e...
research
∙
07/03/2023
Hierarchical Open-vocabulary Universal Image Segmentation
Open-vocabulary image segmentation aims to partition an image into seman...
research
∙
06/16/2023
Robot Learning with Sensorimotor Pre-training
We present a self-supervised sensorimotor pre-training approach for robo...
research
∙
06/15/2023
Neural Relighting with Subsurface Scattering by Learning the Radiance Transfer Gradient
Reconstructing and relighting objects and scenes under varying lighting ...
research
∙
06/08/2023
Modular Visual Question Answering via Code Generation
We present a framework that formulates visual question answering as modu...
research
∙
05/25/2023
Diversify Your Vision Datasets with Automatic Diffusion-Based Augmentation
Many fine-grained classification tasks, like rare animal identification,...
research
∙
05/24/2023
Refocusing Is Key to Transfer Learning
Transfer learning involves adapting a pre-trained model to novel downstr...
research
∙
05/24/2023
Flan-MoE: Scaling Instruction-Finetuned Language Models with Sparse Mixture of Experts
The explosive growth of language models and their applications have led ...
research
∙
05/23/2023
Diffusion Hyperfeatures: Searching Through Time and Space for Semantic Correspondence
Diffusion models have been shown to be capable of generating high-qualit...
research
∙
05/11/2023
Simple Token-Level Confidence Improves Caption Correctness
The ability to judge whether a caption correctly describes an image is a...
research
∙
05/10/2023
Incorporating Structured Representations into Pretrained Vision Language Models Using Scene Graphs
Vision and Language (VL) models have demonstrated remarkable zero-shot p...
research
∙
03/30/2023
PAIR-Diffusion: Object-Level Image Editing with Structure-and-Appearance Paired Diffusion Models
Image editing using diffusion models has witnessed extremely fast-paced ...
research
∙
03/23/2023
Learning and Verification of Task Structure in Instructional Videos
Given the enormous number of instructional videos available online, lear...
research
∙
03/23/2023
Top-Down Visual Attention from Analysis by Synthesis
Current attention algorithms (e.g., self-attention) are stimulus-driven ...
research
∙
03/13/2023
Scaling Vision-Language Models with Sparse Mixture of Experts
The field of natural language processing (NLP) has made significant stri...
research
∙
03/06/2023
Learning Humanoid Locomotion with Transformers
We present a sim-to-real learning-based approach for real-world humanoid...
research
∙
03/02/2023
Dropout Reduces Underfitting
Introduced by Hinton et al. in 2012, dropout has stood the test of time ...
research
∙
02/13/2023
Guiding Pretraining in Reinforcement Learning with Large Language Models
Reinforcement learning algorithms typically struggle in the absence of a...
research
∙
12/30/2022
Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learning
Remote sensing imagery provides comprehensive views of the Earth, where ...
research
∙
12/08/2022
PromptonomyViT: Multi-Task Prompt Learning Improves Video Transformers using Synthetic Scene Data
Action recognition models have achieved impressive results by incorporat...
research
∙
12/01/2022
Shape-Guided Diffusion with Inside-Outside Attention
Shape can specify key object constraints, yet existing text-to-image dif...
research
∙
11/28/2022
G^3: Geolocation via Guidebook Grounding
We demonstrate how language can improve geolocation: the task of predict...
research
∙
11/21/2022
Multitask Vision-Language Prompt Tuning
Prompt Tuning, conditioning on task-specific learned prompt vectors, has...
research
∙
10/18/2022
Using Language to Extend to Unseen Domains
It is expensive to collect training data for every possible domain that ...
research
∙
10/06/2022
Real-World Robot Learning with Masked Visual Pre-training
In this work, we explore self-supervised visual pre-training on images f...
research
∙
09/19/2022
Decentralized Vehicle Coordination: The Berkeley DeepDrive Drone Dataset
Decentralized multiagent planning has been an important field of researc...
research
∙
09/07/2022
Prior Knowledge-Guided Attention in Self-Supervised Vision Transformers
Recent trends in self-supervised representation learning have focused on...
research
∙
09/06/2022
Studying Bias in GANs through the Lens of Race
In this work, we study how the performance and evaluation of generative ...
research
∙
09/01/2022
Visual Prompting via Image Inpainting
How does one adapt a pre-trained visual model to novel downstream tasks ...
research
∙
08/25/2022
Refine and Represent: Region-to-Object Representation Learning
Recent works in self-supervised learning have demonstrated strong perfor...
research
∙
08/14/2022
TL;DW? Summarizing Instructional Videos with Task Relevance Cross-Modal Saliency
YouTube users looking for instructions for a specific task may spend a l...
research
∙
07/07/2022
Back to the Source: Diffusion-Driven Test-Time Adaptation
Test-time adaptation harnesses test inputs to improve the accuracy of a ...
research
∙
07/04/2022
Disentangled Action Recognition with Knowledge Bases
Action in video usually involves the interaction of human with objects. ...
research
∙
06/15/2022
Structured Video Tokens @ Ego4D PNR Temporal Localization Challenge 2022
This technical report describes the SViT approach for the Ego4D Point of...
research
∙
06/13/2022
Bringing Image Scene Structure to Video via Frame-Clip Consistency of Object Tokens
Recent action recognition models have achieved impressive results by int...
research
∙
05/19/2022
Voxel-informed Language Grounding
Natural language applied to natural 2D images describes a fundamentally ...
research
∙
04/28/2022
Reliable Visual Question Answering: Abstain Rather Than Answer Incorrectly
Machine learning has advanced dramatically, narrowing the accuracy gap t...
research
∙
04/23/2022
Visual Attention Emerges from Recurrent Sparse Reconstruction
Visual attention helps achieve robust perception under noise, corruption...
research
∙
04/21/2022
Contrastive Test-Time Adaptation
Test-time adaptation is a special setting of unsupervised domain adaptat...
research
∙
04/20/2022
K-LITE: Learning Transferable Visual Models with External Knowledge
Recent state-of-the-art computer vision systems are trained from natural...
research
∙
04/18/2022
Learning to Listen: Modeling Non-Deterministic Dyadic Facial Motion
We present a framework for modeling interactional communication in dyadi...
research
∙
04/12/2022
ReCLIP: A Strong Zero-Shot Baseline for Referring Expression Comprehension
Training a referring expression comprehension (ReC) model for a new visu...
research
∙
03/19/2022
Teachable Reinforcement Learning via Advice Distillation
Training automated agents to complete complex tasks in interactive envir...
research
∙
03/11/2022
Masked Visual Pre-training for Motor Control
This paper shows that self-supervised visual pre-training from real-worl...
research
∙
02/17/2022
On Guiding Visual Attention with Language Specification
While real world challenges typically define visual categories with lang...
research
∙
01/29/2022
Explaining Reinforcement Learning Policies through Counterfactual Trajectories
In order for humans to confidently decide where to employ RL agents for ...
research
∙
01/10/2022
A ConvNet for the 2020s
The "Roaring 20s" of visual recognition began with the introduction of V...
research
∙
12/21/2021