research
∙
09/03/2023
Multimodal Contrastive Learning with Hard Negative Sampling for Human Activity Recognition
Human Activity Recognition (HAR) systems have been extensively studied b...
share
research
∙
06/01/2023
Towards Learning Discrete Representations via Self-Supervision for Wearables-Based Human Activity Recognition
Human activity recognition (HAR) in wearable computing is typically base...
research
∙
06/01/2023
StyleDrop: Text-to-Image Generation in Any Style
Pre-trained large text-to-image models synthesize impressive images with...
research
∙
06/01/2023
Learning Disentangled Prompts for Compositional Image Synthesis
We study domain-adaptive image synthesis, the problem of teaching pretra...
research
∙
05/25/2023
Prompt-Free Diffusion: Taking "Text" out of Text-to-Image Diffusion Models
Text-to-image (T2I) research has grown explosively in the past year, owi...
research
∙
03/29/2023
Tackling Hate Speech in Low-resource Languages with Context Experts
Given Myanmars historical and socio-political context, hate speech sprea...
research
∙
02/10/2023
MaskSketch: Unpaired Structure-guided Masked Image Generation
Recent conditional image generation methods produce images of remarkable...
research
∙
01/30/2023
Emergence of Maps in the Memories of Blind Navigation Agents
Animal navigation research posits that organisms build and maintain inte...
research
∙
12/17/2022
Cascaded Compositional Residual Learning for Complex Interactive Behaviors
Real-world autonomous missions often require rich interaction with nearb...
research
∙
11/11/2022
Investigating Enhancements to Contrastive Predictive Coding for Human Activity Recognition
The dichotomy between the challenging nature of obtaining annotations fo...
research
∙
11/08/2022
Multi-Stage Based Feature Fusion of Multi-Modal Data for Human Activity Recognition
To properly assist humans in their needs, human activity recognition (HA...
research
∙
10/26/2022
End-to-End Multimodal Representation Learning for Video Dialog
Video-based dialog task is a challenging multimodal learning task that h...
research
∙
10/24/2022
Video based Object 6D Pose Estimation using Transformers
We introduce a Transformer based 6D Object Pose Estimation framework Vid...
research
∙
10/13/2022
Finding Islands of Predictability in Action Forecasting
We address dense action forecasting: the problem of predicting future ac...
research
∙
10/11/2022
VER: Scaling On-Policy RL Leads to the Emergence of Navigation in Embodied Rearrangement
We present Variable Experience Rollout (VER), a technique for efficientl...
research
∙
10/03/2022
Visual Prompt Tuning for Generative Transfer Learning
Transferring knowledge from an image synthesis model trained on a large ...
research
∙
09/09/2022
Improved Masked Image Generation with Token-Critic
Non-autoregressive generative transformers recently demonstrated impress...
research
∙
02/11/2022
Learning Temporal Rules from Noisy Timeseries Data
Events across a timeline are a common data representation, seen in diffe...
research
∙
12/09/2021
BLT: Bidirectional Layout Transformer for Controllable Layout Generation
Creating visual layouts is an important step in graphic design. Automati...
research
∙
11/20/2021
Discrete Representations Strengthen Vision Transformer Robustness
Vision Transformer (ViT) is emerging as the state-of-the-art architectur...
research
∙
09/21/2021
Graph-based Cluttered Scene Generation and Interactive Exploration using Deep Reinforcement Learning
We introduce a novel method to teach a robotic agent to interactively ex...
research
∙
06/28/2021
Unsupervised Discovery of Actions in Instructional Videos
In this paper we address the problem of automatically discovering atomic...
research
∙
06/07/2021
Unsupervised Action Segmentation for Instructional Videos
In this paper we address the problem of automatically discovering atomic...
research
∙
05/14/2021
Automatic Non-Linear Video Editing Transfer
We propose an automatic approach that extracts editing styles in a sourc...
research
∙
03/29/2021
PLAN-B: Predicting Likely Alternative Next Best Sequences for Action Prediction
Action prediction focuses on anticipating actions before they happen. Re...
research
∙
12/11/2020
How to Train PointGoal Navigation Agents on a (Sample and Compute) Budget
PointGoal navigation has seen significant recent interest and progress, ...
research
∙
12/09/2020
Contrastive Predictive Coding for Human Activity Recognition
Feature extraction is crucial for human activity recognition (HAR) using...
research
∙
10/02/2020
Semantic MapNet: Building Allocentric SemanticMaps and Representations from Egocentric Views
We study the task of semantic mapping - specifically, an embodied agent ...
research
∙
08/11/2020
Text as Neural Operator: Image Manipulation by Text Instruction
In this paper, we study a new task that allows users to edit an input im...
research
∙
03/12/2020
Analyzing Visual Representations in Embodied Navigation Tasks
Recent advances in deep reinforcement learning require a large amount of...
research
∙
12/19/2019
Neural Design Network: Graphic Layout Generation with Constraints
Graphic design is essential for visual communication with layouts being ...
research
∙
11/01/2019
Decentralized Distributed PPO: Solving PointGoal Navigation
We present Decentralized Distributed Proximal Policy Optimization (DD-PP...
research
∙
07/09/2019
Estimating Mass Distribution of Articulated Objects through Physical Interaction
We explore the problem of estimating the mass distribution of an articul...
research
∙
07/03/2019
Novel evaluation of surgical activity recognition models using task-based efficiency metrics
Purpose: Surgical task-based metrics (rather than entire procedure metri...
research
∙
06/16/2019
Floors are Flat: Leveraging Semantics for Real-Time Surface Normal Prediction
We propose 4 insights that help to significantly improve the performance...
research
∙
04/06/2019
Embodied Question Answering in Photorealistic Environments with Point Cloud Perception
To help bridge the gap between internet vision-style problems and the go...
research
∙
01/25/2019
Audio-Visual Scene-Aware Dialog
We introduce the task of scene-aware dialog. Given a follow-up question ...
research
∙
09/11/2018
Unbiasing Semantic Segmentation For Robot Perception using Synthetic Data Feature Transfer
Robot perception systems need to perform reliable image segmentation in ...
research
∙
08/22/2018
Video Jigsaw: Unsupervised Learning of Spatiotemporal Context for Video Action Recognition
We propose a self-supervised learning method to jointly reason about spa...
research
∙
06/21/2018
End-to-End Audio Visual Scene-Aware Dialog using Multimodal Attention-Based Video Features
Dialog systems need to understand dynamic visual scenes in order to have...
research
∙
06/01/2018
Audio Visual Scene-Aware Dialog (AVSD) Challenge at DSTC7
Scene-aware dialog systems will be able to have conversations with users...
research
∙
06/01/2018
Surgical Activity Recognition in Robot-Assisted Radical Prostatectomy using Deep Learning
Adverse surgical outcomes are costly to patients and hospitals. Approach...
research
∙
01/26/2018
Object category learning and retrieval with weak supervision
We consider the problem of retrieving objects from image data and learni...
research
∙
01/26/2018
Efficient Hierarchical Graph-Based Segmentation of RGBD Videos
We present an efficient and scalable algorithm for segmenting 3D RGBD po...
research
∙
01/23/2018
Let's Dance: Learning From Online Dance Videos
In recent years, deep neural network approaches have naturally extended ...
research
∙
01/22/2018
DiscrimNet: Semi-Supervised Action Recognition from Videos using Generative Adversarial Networks
We propose an action recognition framework using Gen- erative Adversaria...
research
∙
12/22/2017
Automated Surgical Skill Assessment in RMIS Training
Purpose: Manual feedback in basic RMIS training can consume a significan...
research
∙
09/11/2017
One-Shot Learning for Semantic Segmentation
Low-shot learning methods for image classification support learning from...
research
∙
08/02/2017
Semantic Instance Labeling Leveraging Hierarchical Segmentation
Most of the approaches for indoor RGBD semantic la- beling focus on usin...
research
∙
07/22/2017