research
∙
06/27/2023
Differentially Private Video Activity Recognition
In recent years, differential privacy has seen significant advancements ...
share
research
∙
02/13/2023
PerAda: Parameter-Efficient and Generalizable Federated Learning Personalization with Guarantees
Personalized Federated Learning (pFL) has emerged as a promising solutio...
research
∙
02/12/2023
I^2SB: Image-to-Image Schrödinger Bridge
We propose Image-to-Image Schrödinger Bridge (I^2SB), a new class of con...
research
∙
02/09/2023
Re-ViLM: Retrieval-Augmented Visual Language Model for Zero and Few-Shot Image Captioning
Augmenting pretrained language models (LMs) with a vision encoder (e.g.,...
research
∙
09/15/2022
Test-Time Prompt Tuning for Zero-Shot Generalization in Vision-Language Models
Pre-trained vision-language models (e.g., CLIP) have shown promising zer...
research
∙
08/03/2022
MinVIS: A Minimal Video Instance Segmentation Framework without Video-based Training
We propose MinVIS, a minimal video instance segmentation (VIS) framework...
research
∙
06/17/2022
MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge
Autonomous agents have made great strides in specialist domains like Ata...
research
∙
02/03/2022
Pre-Trained Language Models for Interactive Decision-Making
Language model (LM) pre-training has proven useful for a wide variety of...
research
∙
09/25/2021
Auditing AI models for Verified Deployment under Semantic Specifications
Auditing trained deep learning (DL) models prior to deployment is vital ...
research
∙
09/10/2021
PlaTe: Visually-Grounded Planning with Transformers in Procedural Tasks
In this work, we study the problem of how to leverage instructional vide...
research
∙
06/17/2021
SECANT: Self-Expert Cloning for Zero-Shot Generalization of Visual Policies
Generalization has been a long-standing challenge for reinforcement lear...
research
∙
11/13/2019
Motion Reasoning for Goal-Based Imitation Learning
We address goal-based imitation learning, where the aim is to output the...
research
∙
09/28/2019
Regression Planning Networks
Recent learning-to-plan methods have shown promising results on planning...
research
∙
09/08/2019
Imitation Learning for Human Pose Prediction
Modeling and prediction of human motion dynamics has long been a challen...
research
∙
08/16/2019
Continuous Relaxation of Symbolic Planner for One-Shot Imitation Learning
We address one-shot imitation learning, where the goal is to execute a p...
research
∙
07/02/2019
Procedure Planning in Instructional Videos
We propose a new challenging task: procedure planning in instructional v...
research
∙
01/09/2019
D^3TW: Discriminative Differentiable Dynamic Time Warping for Weakly Supervised Action Alignment and Segmentation
We address weakly-supervised action alignment and segmentation in videos...
research
∙
10/23/2018
Action-Agnostic Human Pose Forecasting
Predicting and forecasting human dynamics is a very interesting but chal...
research
∙
07/10/2018
Neural Task Graphs: Generalizing to Unseen Tasks from a Single Video Demonstration
Our goal is for a robot to execute a previously unseen task based on a s...
research
∙
06/11/2018
Learning to Decompose and Disentangle Representations for Video Prediction
Our goal is to predict future video frames given a sequence of input fra...
research
∙
03/07/2017
Unsupervised Visual-Linguistic Reference Resolution in Instructional Videos
We propose an unsupervised method for reference resolution in instructio...
research
∙
01/07/2017
Unsupervised Learning of Long-Term Motion Dynamics for Videos
We present an unsupervised representation learning approach that compact...
research
∙
07/28/2016
Connectionist Temporal Modeling for Weakly Supervised Action Labeling
We propose a weakly-supervised framework for action labeling in video, w...
research
∙
04/05/2016
Forecasting Interactive Dynamics of Pedestrians with Fictitious Play
We develop predictive models of pedestrian dynamics by encoding the coup...
research
∙
11/19/2015