research
∙
09/12/2023
LEAP Hand: Low-Cost, Efficient, and Anthropomorphic Hand for Robot Learning
Dexterous manipulation has been a long-standing challenge in robotics. W...
share
research
∙
09/12/2023
Language Models as Black-Box Optimizers for Vision-Language Models
Vision-language models (VLMs) pre-trained on web-scale datasets have dem...
research
∙
09/05/2023
Efficient RL via Disentangled Environment and Agent Representations
Agents that are aware of the separation between themselves and their env...
research
∙
08/21/2023
Structured World Models from Human Videos
We tackle the problem of learning complex, general behaviors directly in...
research
∙
08/17/2023
Predicting Crop Yield With Machine Learning: An Extensive Analysis Of Input Modalities And Models On a Field and sub-field Level
We introduce a simple yet effective early fusion method for crop yield p...
research
∙
06/07/2023
A Framework for Designing Anthropomorphic Soft Hands through Interaction
Modeling and simulating soft robot hands can aid in design iteration for...
research
∙
06/02/2023
VisualGPTScore: Visio-Linguistic Reasoning with Multimodal Generative Pre-Training Scores
Vision-language models (VLMs) discriminatively pre-trained with contrast...
research
∙
04/17/2023
Affordances from Human Videos as a Versatile Representation for Robotics
Building a robot that can understand and learn to interact by watching h...
research
∙
03/28/2023
Your Diffusion Model is Secretly a Zero-Shot Classifier
The recent wave of large-scale text-to-image diffusion models has dramat...
research
∙
02/27/2023
Internet Explorer: Targeted Representation Learning on the Open Web
Modern vision models typically rely on fine-tuning general-purpose model...
research
∙
02/13/2023
ALAN: Autonomously Exploring Robotic Agents in the Real World
Robotic agents that operate autonomously in the real world need to conti...
research
∙
01/16/2023
Multimodality Helps Unimodality: Cross-Modal Few-Shot Learning with Multimodal Models
The ability to quickly learn a new task with minimal instruction - known...
research
∙
12/08/2022
VideoDex: Learning Dexterity from Internet Videos
To build general robotic agents that can operate in many environments, i...
research
∙
12/08/2022
HERD: Continuous Human-to-Robot Evolution for Learning from Human Demonstration
The ability to learn from human demonstration endows robots with the abi...
research
∙
10/18/2022
Deep Whole-Body Control: Learning a Unified Policy for Manipulation and Locomotion
An attached arm can significantly increase the applicability of legged r...
research
∙
10/10/2022
Learning with an Evolving Class Ontology
Lifelong learners must recognize concept vocabularies that evolve over t...
research
∙
09/29/2022
Understanding Collapse in Non-Contrastive Siamese Representation Learning
Contrastive methods have led a recent surge in the performance of self-s...
research
∙
05/12/2022
Topologically-Aware Deformation Fields for Single-View 3D Reconstruction
We present a framework for learning 3D object shapes and dense cross-obj...
research
∙
03/21/2022
Generating Fast and Slow: Scene Decomposition via Reconstruction
We consider the problem of segmenting scenes into constituent entities, ...
research
∙
02/21/2022
Robotic Telekinesis: Learning a Robotic Hand Imitator by Watching Humans on Youtube
We build a system that enables any human to control a robot hand and arm...
research
∙
02/10/2022
REvolveR: Continuous Evolutionary Models for Robot-to-robot Policy Transfer
A popular paradigm in robotic learning is to train a policy from scratch...
research
∙
01/18/2022
Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents
Can world knowledge learned by large language models (LLMs) be used to a...
research
∙
01/17/2022
The CLEAR Benchmark: Continual LEArning on Real-World Imagery
Continual learning (CL) is widely regarded as crucial challenge for life...
research
∙
12/06/2021
Functional Regularization for Reinforcement Learning via Learned Fourier Features
We propose a simple architecture for deep reinforcement learning by embe...
research
∙
12/03/2021
Coupling Vision and Proprioception for Navigation of Legged Robots
We exploit the complementary strengths of vision and proprioception to a...
research
∙
12/02/2021
Differentiable Spatial Planning using Transformers
We consider the problem of spatial path planning. In contrast to the cla...
research
∙
11/04/2021
Generalization in Dexterous Manipulation via Geometry-Aware Multi-Task Learning
Dexterous manipulation of arbitrary objects, a fundamental daily task fo...
research
∙
10/28/2021
Accelerating Robotic Reinforcement Learning via Parameterized Action Primitives
Despite the potential of reinforcement learning (RL) for building genera...
research
∙
10/25/2021
Minimizing Energy Consumption Leads to the Emergence of Gaits in Legged Robots
Legged locomotion is commonly studied and expressed as a discrete set of...
research
∙
10/18/2021
Discovering and Achieving Goals via World Models
How can artificial agents learn to solve many diverse tasks in complex v...
research
∙
07/08/2021
RMA: Rapid Motor Adaptation for Legged Robots
Successful real-world deployment of legged robots would require them to ...
research
∙
04/15/2021
Auto-Tuned Sim-to-Real Transfer
Policies trained in simulation often fail when transferred to the real w...
research
∙
12/17/2020
Worldsheet: Wrapping the World in a 3D Sheet for View Synthesis from a Single Image
We present Worldsheet, a method for novel view synthesis using just a si...
research
∙
12/15/2020
FLAVR: Flow-Agnostic Video Representations for Fast Frame Interpolation
A majority of approaches solve the problem of video frame interpolation ...
research
∙
08/27/2020
Planning in Learned Latent Action Spaces for Generalizable Legged Locomotion
Hierarchical learning has been successful at learning generalizable loco...
research
∙
08/05/2020
Learning Long-term Visual Dynamics with Region Proposal Interaction Networks
Learning long-term dynamics models is the key to understanding physical ...
research
∙
07/09/2020
One Policy to Control Them All: Shared Modular Policies for Agent-Agnostic Control
Reinforcement learning is typically concerned with learning control poli...
research
∙
06/22/2020
Locally Masked Convolution for Autoregressive Models
High-dimensional generative models have many applications including imag...
research
∙
05/12/2020
Planning to Explore via Self-Supervised World Models
Reinforcement learning allows solving complex tasks, however, the learni...
research
∙
03/13/2020
Sparse Graphical Memory for Robust Planning
To operate effectively in the real world, artificial agents must act fro...
research
∙
11/21/2019
Third-Person Visual Imitation Learning via Decoupled Hierarchical Controller
We study a generalized setup for learning from demonstration to build an...
research
∙
06/10/2019
Self-Supervised Exploration via Disagreement
Efficient exploration is a long-standing problem in sensorimotor learnin...
research
∙
02/14/2019
Learning to Control Self-Assembling Morphologies: A Study of Generalization via Modularity
Contemporary sensorimotor learning approaches typically start with an ex...
research
∙
08/13/2018
Large-Scale Study of Curiosity-Driven Learning
Reinforcement learning algorithms rely on carefully engineering environm...
research
∙
07/19/2018
Compositional GAN: Learning Conditional Image Composition
Generative Adversarial Networks (GANs) can produce images of surprising ...
research
∙
06/21/2018
Learning Instance Segmentation by Interaction
We present an approach for building an active agent that learns to segme...
research
∙
04/23/2018
Zero-Shot Visual Imitation
The current dominant paradigm for imitation learning relies on strong su...
research
∙
02/28/2018
Investigating Human Priors for Playing Video Games
What makes humans so good at solving seemingly complex video games? Unli...
research
∙
11/30/2017
Toward Multimodal Image-to-Image Translation
Many image-to-image translation problems are ambiguous, as a single inpu...
research
∙
05/15/2017
