Yuke Zhu

OCEAN: Online Task Inference for Compositional Tasks with Context Adaptation

Real-world tasks often exhibit a compositional structure that contains a...
08/17/2020 ∙ by Hongyu Ren, et al. ∙ 1 ∙ share

read it
Spherical Feature Transform for Deep Metric Learning

Data augmentation in feature space is effective to increase data diversi...
08/04/2020 ∙ by Yuke Zhu, et al. ∙ 0 ∙ share

read it
Adaptive Procedural Task Generation for Hard-Exploration Problems

We introduce Adaptive Procedural Task Generation (APT-Gen), an approach ...
07/01/2020 ∙ by Kuan Fang, et al. ∙ 18 ∙ share

read it
Scaling Robot Supervision to Hundreds of Hours with RoboTurk: Robotic Manipulation Dataset through Human Reasoning and Dexterity

Large, richly annotated datasets have accelerated progress in fields suc...
11/11/2019 ∙ by Ajay Mandlekar, et al. ∙ 0 ∙ share

read it
Dynamics Learning with Cascaded Variational Inference for Multi-Step Manipulation

The fundamental challenge of planning for multi-step manipulation is to ...
10/29/2019 ∙ by Kuan Fang, et al. ∙ 10 ∙ share

read it
KETO: Learning Keypoint Representations for Tool Manipulation

We aim to develop an algorithm for robots to manipulate novel objects as...
10/26/2019 ∙ by Zengyi Qin, et al. ∙ 0 ∙ share

read it
Causal Induction from Visual Observations for Goal Directed Tasks

Causal reasoning has been an indispensable capability for humans and oth...
10/03/2019 ∙ by Suraj Nair, et al. ∙ 7 ∙ share

read it
Regression Planning Networks

Recent learning-to-plan methods have shown promising results on planning...
09/28/2019 ∙ by Danfei Xu, et al. ∙ 87 ∙ share

read it
Dual Sequential Monte Carlo: Tunneling Filtering and Planning in Continuous POMDPs

We present the DualSMC network that solves continuous POMDPs by learning...
09/28/2019 ∙ by Yunbo Wang, et al. ∙ 15 ∙ share

read it
SURREAL-System: Fully-Integrated Stack for Distributed Deep Reinforcement Learning

We present an overview of SURREAL-System, a reproducible, flexible, and ...
09/27/2019 ∙ by Linxi Fan, et al. ∙ 0 ∙ share

read it
Situational Fusion of Visual Representation for Visual Navigation

A complex visual navigation task puts an agent in different situations w...
08/24/2019 ∙ by William B. Shen, et al. ∙ 12 ∙ share

read it
Continuous Relaxation of Symbolic Planner for One-Shot Imitation Learning

We address one-shot imitation learning, where the goal is to execute a p...
08/16/2019 ∙ by De-An Huang, et al. ∙ 3 ∙ share

read it
Making Sense of Vision and Touch: Learning Multimodal Representations for Contact-Rich Tasks

Contact-rich manipulation tasks in unstructured environments often requi...
07/28/2019 ∙ by Michelle A. Lee, et al. ∙ 0 ∙ share

read it
DenseFusion: 6D Object Pose Estimation by Iterative Dense Fusion

A key technical challenge in performing 6D object pose estimation from R...
01/15/2019 ∙ by Chen Wang, et al. ∙ 10 ∙ share

read it
RoboTurk: A Crowdsourcing Platform for Robotic Skill Learning through Imitation

Imitation Learning has empowered recent advances in learning robotic man...
11/07/2018 ∙ by Ajay Mandlekar, et al. ∙ 4 ∙ share

read it
Making Sense of Vision and Touch: Self-Supervised Learning of Multimodal Representations for Contact-Rich Tasks

Contact-rich manipulation tasks in unstructured environments often requi...
10/24/2018 ∙ by Michelle A. Lee, et al. ∙ 4 ∙ share

read it
Neural Task Graphs: Generalizing to Unseen Tasks from a Single Video Demonstration

Our goal is for a robot to execute a previously unseen task based on a s...
07/10/2018 ∙ by De-An Huang, et al. ∙ 2 ∙ share

read it
Learning Task-Oriented Grasping for Tool Manipulation from Simulated Self-Supervision

Tool manipulation is vital for facilitating robots to complete challengi...
06/25/2018 ∙ by Kuan Fang, et al. ∙ 8 ∙ share

read it
Reinforcement and Imitation Learning for Diverse Visuomotor Skills

We propose a model-free deep reinforcement learning method that leverage...
02/26/2018 ∙ by Yuke Zhu, et al. ∙ 0 ∙ share

read it
AI2-THOR: An Interactive 3D Environment for Visual AI

We introduce The House Of inteRactions (THOR), a framework for visual AI...
12/14/2017 ∙ by Eric Kolve, et al. ∙ 0 ∙ share

read it
Neural Task Programming: Learning to Generalize Across Hierarchical Tasks

In this work, we propose a novel robot learning framework called Neural ...
10/04/2017 ∙ by Danfei Xu, et al. ∙ 0 ∙ share

read it
Visual Semantic Planning using Deep Successor Representations

A crucial capability of real-world intelligent agents is their ability t...
05/23/2017 ∙ by Yuke Zhu, et al. ∙ 0 ∙ share

read it
Scene Graph Generation by Iterative Message Passing

Understanding a visual scene goes beyond recognizing individual objects ...
01/10/2017 ∙ by Danfei Xu, et al. ∙ 0 ∙ share

read it
Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learning

Two less addressed issues of deep reinforcement learning are (1) lack of...
09/16/2016 ∙ by Yuke Zhu, et al. ∙ 0 ∙ share

read it
Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations

Despite progress in perceptual tasks such as image classification, compu...
02/23/2016 ∙ by Ranjay Krishna, et al. ∙ 0 ∙ share

read it
Visual7W: Grounded Question Answering in Images

We have seen great progress in basic perceptual tasks such as object rec...
11/11/2015 ∙ by Yuke Zhu, et al. ∙ 0 ∙ share

read it
Building a Large-scale Multimodal Knowledge Base System for Answering Visual Queries

The complexity of the visual world creates significant challenges for co...
07/20/2015 ∙ by Yuke Zhu, et al. ∙ 0 ∙ share

read it

Yuke Zhu

Featured Co-authors

Li Fei-Fei

Anima Anandkumar

Silvio Savarese

Joshua B. Tenenbaum

Jure Leskovec

Abhinav Gupta

Dieter Fox

Nando de Freitas

Christopher Ré

Ali Farhadi

Ce Zhang

OCEAN: Online Task Inference for Compositional Tasks with Context Adaptation

Spherical Feature Transform for Deep Metric Learning

Adaptive Procedural Task Generation for Hard-Exploration Problems

Scaling Robot Supervision to Hundreds of Hours with RoboTurk: Robotic Manipulation Dataset through Human Reasoning and Dexterity

Dynamics Learning with Cascaded Variational Inference for Multi-Step Manipulation

KETO: Learning Keypoint Representations for Tool Manipulation

Causal Induction from Visual Observations for Goal Directed Tasks

Regression Planning Networks

Dual Sequential Monte Carlo: Tunneling Filtering and Planning in Continuous POMDPs

SURREAL-System: Fully-Integrated Stack for Distributed Deep Reinforcement Learning

Situational Fusion of Visual Representation for Visual Navigation

Continuous Relaxation of Symbolic Planner for One-Shot Imitation Learning

Making Sense of Vision and Touch: Learning Multimodal Representations for Contact-Rich Tasks

DenseFusion: 6D Object Pose Estimation by Iterative Dense Fusion

RoboTurk: A Crowdsourcing Platform for Robotic Skill Learning through Imitation

Making Sense of Vision and Touch: Self-Supervised Learning of Multimodal Representations for Contact-Rich Tasks

Neural Task Graphs: Generalizing to Unseen Tasks from a Single Video Demonstration

Learning Task-Oriented Grasping for Tool Manipulation from Simulated Self-Supervision

Reinforcement and Imitation Learning for Diverse Visuomotor Skills

AI2-THOR: An Interactive 3D Environment for Visual AI

Neural Task Programming: Learning to Generalize Across Hierarchical Tasks

Visual Semantic Planning using Deep Successor Representations

Scene Graph Generation by Iterative Message Passing

Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learning

Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations

Visual7W: Grounded Question Answering in Images

Building a Large-scale Multimodal Knowledge Base System for Answering Visual Queries