b'Deepak Pathak'

research

∙ 09/12/2023

LEAP Hand: Low-Cost, Efficient, and Anthropomorphic Hand for Robot Learning

Dexterous manipulation has been a long-standing challenge in robotics. W...

0 Kenneth Shaw, et al. ∙

research

∙ 09/12/2023

Language Models as Black-Box Optimizers for Vision-Language Models

Vision-language models (VLMs) pre-trained on web-scale datasets have dem...

0 Samuel Yu, et al. ∙

research

∙ 09/05/2023

Efficient RL via Disentangled Environment and Agent Representations

Agents that are aware of the separation between themselves and their env...

0 Kevin Gmelin, et al. ∙

research

∙ 08/21/2023

Structured World Models from Human Videos

We tackle the problem of learning complex, general behaviors directly in...

0 Russell Mendonca, et al. ∙

research

∙ 08/17/2023

Predicting Crop Yield With Machine Learning: An Extensive Analysis Of Input Modalities And Models On a Field and sub-field Level

We introduce a simple yet effective early fusion method for crop yield p...

0 Deepak Pathak, et al. ∙

research

∙ 06/07/2023

A Framework for Designing Anthropomorphic Soft Hands through Interaction

Modeling and simulating soft robot hands can aid in design iteration for...

0 Pragna Mannam, et al. ∙

research

∙ 06/02/2023

VisualGPTScore: Visio-Linguistic Reasoning with Multimodal Generative Pre-Training Scores

Vision-language models (VLMs) discriminatively pre-trained with contrast...

0 Zhiqiu Lin, et al. ∙

research

∙ 04/17/2023

Affordances from Human Videos as a Versatile Representation for Robotics

Building a robot that can understand and learn to interact by watching h...

0 Shikhar Bahl, et al. ∙

research

∙ 03/28/2023

Your Diffusion Model is Secretly a Zero-Shot Classifier

The recent wave of large-scale text-to-image diffusion models has dramat...

0 Alexander C. Li, et al. ∙

research

∙ 02/27/2023

Internet Explorer: Targeted Representation Learning on the Open Web

Modern vision models typically rely on fine-tuning general-purpose model...

0 Alexander C. Li, et al. ∙

research

∙ 02/13/2023

ALAN: Autonomously Exploring Robotic Agents in the Real World

Robotic agents that operate autonomously in the real world need to conti...

0 Russell Mendonca, et al. ∙

research

∙ 01/16/2023

Multimodality Helps Unimodality: Cross-Modal Few-Shot Learning with Multimodal Models

The ability to quickly learn a new task with minimal instruction - known...

0 Zhiqiu Lin, et al. ∙

research

∙ 12/08/2022

VideoDex: Learning Dexterity from Internet Videos

To build general robotic agents that can operate in many environments, i...

0 Kenneth Shaw, et al. ∙

research

∙ 12/08/2022

HERD: Continuous Human-to-Robot Evolution for Learning from Human Demonstration

The ability to learn from human demonstration endows robots with the abi...

0 Xingyu Liu, et al. ∙

research

∙ 10/18/2022

Deep Whole-Body Control: Learning a Unified Policy for Manipulation and Locomotion

An attached arm can significantly increase the applicability of legged r...

6 Zipeng Fu, et al. ∙

research

∙ 10/10/2022

Learning with an Evolving Class Ontology

Lifelong learners must recognize concept vocabularies that evolve over t...

0 Zhiqiu Lin, et al. ∙

research

∙ 09/29/2022

Understanding Collapse in Non-Contrastive Siamese Representation Learning

Contrastive methods have led a recent surge in the performance of self-s...

39 Alexander C. Li, et al. ∙

research

∙ 05/12/2022

Topologically-Aware Deformation Fields for Single-View 3D Reconstruction

We present a framework for learning 3D object shapes and dense cross-obj...

0 Shivam Duggal, et al. ∙

research

∙ 03/21/2022

Generating Fast and Slow: Scene Decomposition via Reconstruction

We consider the problem of segmenting scenes into constituent entities, ...

0 Mihir Prabhudesai, et al. ∙

research

∙ 02/21/2022

Robotic Telekinesis: Learning a Robotic Hand Imitator by Watching Humans on Youtube

We build a system that enables any human to control a robot hand and arm...

0 Aravind Sivakumar, et al. ∙

research

∙ 02/10/2022

REvolveR: Continuous Evolutionary Models for Robot-to-robot Policy Transfer

A popular paradigm in robotic learning is to train a policy from scratch...

0 Xingyu Liu, et al. ∙

research

∙ 01/18/2022

Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents

Can world knowledge learned by large language models (LLMs) be used to a...

0 Wenlong Huang, et al. ∙

research

∙ 01/17/2022

The CLEAR Benchmark: Continual LEArning on Real-World Imagery

Continual learning (CL) is widely regarded as crucial challenge for life...

5 Zhiqiu Lin, et al. ∙

research

∙ 12/06/2021

Functional Regularization for Reinforcement Learning via Learned Fourier Features

We propose a simple architecture for deep reinforcement learning by embe...

0 Alexander C. Li, et al. ∙

research

∙ 12/03/2021

Coupling Vision and Proprioception for Navigation of Legged Robots

We exploit the complementary strengths of vision and proprioception to a...

4 Zipeng Fu, et al. ∙

research

∙ 12/02/2021

Differentiable Spatial Planning using Transformers

We consider the problem of spatial path planning. In contrast to the cla...

12 Devendra Singh Chaplot, et al. ∙

research

∙ 11/04/2021

Generalization in Dexterous Manipulation via Geometry-Aware Multi-Task Learning

Dexterous manipulation of arbitrary objects, a fundamental daily task fo...

0 Wenlong Huang, et al. ∙

research

∙ 10/28/2021

Accelerating Robotic Reinforcement Learning via Parameterized Action Primitives

Despite the potential of reinforcement learning (RL) for building genera...

0 Murtaza Dalal, et al. ∙

research

∙ 10/25/2021

Minimizing Energy Consumption Leads to the Emergence of Gaits in Legged Robots

Legged locomotion is commonly studied and expressed as a discrete set of...

1 Zipeng Fu, et al. ∙

research

∙ 10/18/2021

Discovering and Achieving Goals via World Models

How can artificial agents learn to solve many diverse tasks in complex v...

8 Russell Mendonca, et al. ∙

research

∙ 07/08/2021

RMA: Rapid Motor Adaptation for Legged Robots

Successful real-world deployment of legged robots would require them to ...

11 Ashish Kumar, et al. ∙

research

∙ 04/15/2021

Auto-Tuned Sim-to-Real Transfer

Policies trained in simulation often fail when transferred to the real w...

0 Yuqing Du, et al. ∙

research

∙ 12/17/2020

Worldsheet: Wrapping the World in a 3D Sheet for View Synthesis from a Single Image

We present Worldsheet, a method for novel view synthesis using just a si...

0 Ronghang Hu, et al. ∙

research

∙ 12/15/2020

FLAVR: Flow-Agnostic Video Representations for Fast Frame Interpolation

A majority of approaches solve the problem of video frame interpolation ...

7 Tarun Kalluri, et al. ∙

research

∙ 08/27/2020

Planning in Learned Latent Action Spaces for Generalizable Legged Locomotion

Hierarchical learning has been successful at learning generalizable loco...

0 Tianyu Li, et al. ∙

research

∙ 08/05/2020

Learning Long-term Visual Dynamics with Region Proposal Interaction Networks

Learning long-term dynamics models is the key to understanding physical ...

2 Haozhi Qi, et al. ∙

research

∙ 07/09/2020

One Policy to Control Them All: Shared Modular Policies for Agent-Agnostic Control

Reinforcement learning is typically concerned with learning control poli...

9 Wenlong Huang, et al. ∙

research

∙ 06/22/2020

Locally Masked Convolution for Autoregressive Models

High-dimensional generative models have many applications including imag...

61 Ajay Jain, et al. ∙

research

∙ 05/12/2020

Planning to Explore via Self-Supervised World Models

Reinforcement learning allows solving complex tasks, however, the learni...

2 Ramanan Sekar, et al. ∙

research

∙ 03/13/2020

Sparse Graphical Memory for Robust Planning

To operate effectively in the real world, artificial agents must act fro...

17 Michael (Misha) Laskin, et al. ∙

research

∙ 11/21/2019

Third-Person Visual Imitation Learning via Decoupled Hierarchical Controller

We study a generalized setup for learning from demonstration to build an...

0 Pratyusha Sharma, et al. ∙

research

∙ 06/10/2019

Self-Supervised Exploration via Disagreement

Efficient exploration is a long-standing problem in sensorimotor learnin...

0 Deepak Pathak, et al. ∙

research

∙ 02/14/2019

Learning to Control Self-Assembling Morphologies: A Study of Generalization via Modularity

Contemporary sensorimotor learning approaches typically start with an ex...

12 Deepak Pathak, et al. ∙

research

∙ 08/13/2018

Large-Scale Study of Curiosity-Driven Learning

Reinforcement learning algorithms rely on carefully engineering environm...

0 Yuri Burda, et al. ∙

research

∙ 07/19/2018

Compositional GAN: Learning Conditional Image Composition

Generative Adversarial Networks (GANs) can produce images of surprising ...

16 Samaneh Azadi, et al. ∙

research

∙ 06/21/2018

Learning Instance Segmentation by Interaction

We present an approach for building an active agent that learns to segme...

2 Deepak Pathak, et al. ∙

research

∙ 04/23/2018

Zero-Shot Visual Imitation

The current dominant paradigm for imitation learning relies on strong su...

0 Deepak Pathak, et al. ∙

research

∙ 02/28/2018

Investigating Human Priors for Playing Video Games

What makes humans so good at solving seemingly complex video games? Unli...

0 Rachit Dubey, et al. ∙

research

∙ 11/30/2017

Toward Multimodal Image-to-Image Translation

Many image-to-image translation problems are ambiguous, as a single inpu...

0 Jun-Yan Zhu, et al. ∙

research

∙ 05/15/2017

Curiosity-driven Exploration by Self-supervised Prediction

In many real-world scenarios, rewards extrinsic to the agent are extreme...

0 Deepak Pathak, et al. ∙

Deepak Pathak

Featured Co-authors