research
∙
03/06/2023
PaLM-E: An Embodied Multimodal Language Model
Large language models excel at a wide range of complex tasks. However, e...
share
research
∙
02/22/2023
Scaling Robot Learning with Semantically Imagined Experience
Recent advances in robot learning have shown promise in enabling robots ...
research
∙
11/21/2022
Robotic Skill Acquisition via Instruction Augmentation with Vision-Language Models
In recent years, much progress has been made in learning robotic manipul...
research
∙
11/03/2022
Contrastive Value Learning: Implicit Models for Simple Offline RL
Model-based reinforcement learning (RL) methods are appealing in the off...
research
∙
10/12/2022
Interactive Language: Talking to Robots in Real Time
We present a framework for building interactive, real-time, natural lang...
research
∙
07/12/2022
Inner Monologue: Embodied Reasoning through Planning with Language Models
Recent works have shown how the reasoning capabilities of Large Language...
research
∙
05/12/2022
Visuomotor Control in Multi-Object Scenes Using Object-Aware Representations
Perceptual understanding of the scene and the relationship between its d...
research
∙
11/29/2021
Improving Zero-shot Generalization in Offline Reinforcement Learning using Generalized Similarity Functions
Reinforcement learning (RL) agents are widely used for solving complex s...
research
∙
09/01/2021
Implicit Behavioral Cloning
We find that across a wide range of robot policy learning scenarios, tre...
research
∙
06/07/2021
XIRL: Cross-embodiment Inverse Reinforcement Learning
We investigate the visual cross-embodiment imitation setting, in which a...
research
∙
04/29/2021
With a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual Representations
Self-supervised learning algorithms based on instance discrimination tra...
research
∙
03/14/2021
Offline Reinforcement Learning with Fisher Divergence Critic Regularization
Many modern approaches to offline Reinforcement Learning (RL) utilize be...
research
∙
12/06/2020
Learning to Rearrange Deformable Cables, Fabrics, and Bags with Goal-Conditioned Transporter Networks
Rearranging and manipulating deformable objects such as cables, fabrics,...
research
∙
10/27/2020
Transporter Networks: Rearranging the Visual World for Robotic Manipulation
Robotic manipulation can be formulated as inducing a sequence of spatial...
research
∙
08/23/2020
ADAIL: Adaptive Adversarial Imitation Learning
We present the ADaptive Adversarial Imitation Learning (ADAIL) algorithm...
research
∙
06/27/2020
Counting Out Time: Class Agnostic Video Repetition Counting in the Wild
We present an approach for estimating the period with which an action is...
research
∙
01/08/2020
An Analysis of Object Representations in Deep Visual Trackers
Fully convolutional deep correlation networks are integral components of...
research
∙
12/10/2019
Imitation Learning via Off-Policy Distribution Matching
When performing imitation learning from expert demonstrations, distribut...
research
∙
09/04/2019
Beyond Photo Realism for Domain Adaptation from Synthetic Data
As synthetic imagery is used more frequently in training deep models, it...
research
∙
04/16/2019
Temporal Cycle-Consistency Learning
We introduce a self-supervised representation learning method based on t...
research
∙
03/05/2019
Learning Latent Plans from Play
We propose learning from teleoperated play data (LfP) as a way to scale ...
research
∙
09/09/2018
Addressing Sample Inefficiency and Reward Bias in Inverse Reinforcement Learning
The Generative Adversarial Imitation Learning (GAIL) framework from Ho &...
research
∙
08/02/2018
Learning Actionable Representations from Visual Observations
In this work we explore a new approach for robots to teach themselves ab...
research
∙
07/05/2018
Discovery of Latent 3D Keypoints via End-to-end Geometric Reasoning
This paper presents KeypointNet, an end-to-end geometric reasoning frame...
research
∙
03/22/2018
PersonLab: Person Pose Estimation and Instance Segmentation with a Bottom-Up, Part-Based, Geometric Embedding Model
We present a box-free bottom-up approach for the tasks of pose estimatio...
research
∙
01/06/2017
Towards Accurate Multi-person Pose Estimation in the Wild
We propose a method for multi-person detection and 2-D pose estimation t...
research
∙
07/13/2016
Accelerating Eulerian Fluid Simulation With Convolutional Networks
Efficient simulation of the Navier-Stokes equations for fluid flow is a ...
research
∙
04/09/2015
Unsupervised Feature Learning from Temporal Data
Current state-of-the-art classification and detection algorithms rely on...
research
∙
12/18/2014
Unsupervised Learning of Spatiotemporally Coherent Metrics
Current state-of-the-art classification and detection algorithms rely on...
research
∙
11/16/2014
Efficient Object Localization Using Convolutional Networks
Recent state-of-the-art performance on human-body pose estimation has be...
research
∙
09/28/2014
MoDeep: A Deep Learning Framework Using Motion Features for Human Pose Estimation
In this work, we propose a novel and efficient method for articulated hu...
research
∙
06/11/2014
Joint Training of a Convolutional Network and a Graphical Model for Human Pose Estimation
This paper proposes a new hybrid architecture that consists of a deep Co...
research
∙
12/27/2013