b'Jiajun Wu'

research

∙ 05/08/2022

Unsupervised Discovery and Composition of Object Light Fields

Neural scene representations, both continuous and discrete, have recentl...

Cameron Smith, et al. ∙

research

∙ 05/05/2022

RoboCraft: Learning to See, Simulate, and Shape Elasto-Plastic Objects with Graph Networks

Modeling and manipulating elasto-plastic objects are essential capabilit...

Haochen Shi, et al. ∙

research

∙ 05/04/2022

Video Extrapolation in Space and Time

Novel view synthesis (NVS) and video prediction (VP) are typically consi...

Yunzhi Zhang, et al. ∙

research

∙ 04/28/2022

Rotationally Equivariant 3D Object Detection

Rotation equivariance has recently become a strongly desired property in...

Hong-Xing Yu, et al. ∙

research

∙ 04/05/2022

ObjectFolder 2.0: A Multisensory Object Dataset for Sim2Real Transfer

Objects play a crucial role in our everyday activities. Though multisens...

Ruohan Gao, et al. ∙

research

∙ 03/15/2022

Vision-Based Manipulators Need to Also See from Their Hands

We study how the choice of visual perspective affects learning and gener...

Kyle Hsu, et al. ∙

research

∙ 02/17/2022

Grammar-Based Grounded Lexicon Learning

We present Grammar-Based Grounded Lexicon Learning (G2L2), a lexicalist ...

Jiayuan Mao, et al. ∙

research

∙ 09/16/2021

ObjectFolder: A Dataset of Objects with Implicit Visual, Auditory, and Tactile Representations

Multisensory object-centric perception, reasoning, and interaction have ...

Ruohan Gao, et al. ∙

research

∙ 08/28/2021

DASH: Modularized Human Manipulation Simulation with Vision and Language for Embodied AI

Creating virtual humans with embodied, human-like perceptual and actuati...

Yifeng Jiang, et al. ∙

research

∙ 08/06/2021

BEHAVIOR: Benchmark for Everyday Household Activities in Virtual, Interactive, and Ecological Environments

We introduce BEHAVIOR, a benchmark for embodied AI with 100 activities i...

Sanjana Srivastava, et al. ∙

research

∙ 08/06/2021

iGibson 2.0: Object-Centric Simulation for Robot Learning of Everyday Household Tasks

Recent research in embodied AI has been boosted by the use of simulation...

Chengshu Li, et al. ∙

research

∙ 07/16/2021

Unsupervised Discovery of Object Radiance Fields

We study the problem of inferring an object-centric scene representation...

Hong-Xing Yu, et al. ∙

research

∙ 06/10/2021

Temporal and Object Quantification Networks

We present Temporal and Object Quantification Networks (TOQ-Nets), a new...

Jiayuan Mao, et al. ∙

research

∙ 04/22/2021

KeypointDeformer: Unsupervised 3D Keypoint Discovery for Shape Control

We introduce KeypointDeformer, a novel unsupervised method for shape con...

Tomas Jakab, et al. ∙

research

∙ 04/22/2021

Hierarchical Motion Understanding via Motion Programs

Current approaches to video analysis of human motion focus on raw pixels...

Sumith Kulal, et al. ∙

research

∙ 04/08/2021

De-rendering the World's Revolutionary Artefacts

Recent works have shown exciting results in unsupervised image de-render...

Shangzhe Wu, et al. ∙

research

∙ 04/08/2021

3D Shape Generation and Completion through Point-Voxel Diffusion

We propose a novel approach for probabilistic generative modeling of 3D ...

Linqi Zhou, et al. ∙

research

∙ 03/30/2021

Grounding Physical Concepts of Objects and Events Through Dynamic Visual Reasoning

We study the problem of dynamic visual reasoning on raw videos. This is ...

Zhenfang Chen, et al. ∙

research

∙ 03/30/2021

Repopulating Street Scenes

We present a framework for automatically reconfiguring images of street ...

Yifan Wang, et al. ∙

research

∙ 01/07/2021

Learning Temporal Dynamics from Cycles in Narrated Video

Learning to model how the world changes as time elapses has proven a cha...

Dave Epstein, et al. ∙

research

∙ 12/31/2020

Language-Mediated, Object-Centric Representation Learning

We present Language-mediated, Object-centric Representation Learning (LO...

Ruocheng Wang, et al. ∙

research

∙ 12/23/2020

Augmenting Policy Learning with Routines Discovered from a Single Demonstration

Humans can abstract prior knowledge from very little data and use it to ...

Zelin Zhao, et al. ∙

research

∙ 12/21/2020

Object-Centric Diagnosis of Visual Reasoning

When answering questions about an image, it not only needs knowing what ...

Jianwei Yang, et al. ∙

research

∙ 12/17/2020

Neural Radiance Flow for 4D View Synthesis and Video Processing

We present a method, Neural Radiance Flow (NeRFlow),to learn a 4D spatia...

Yilun Du, et al. ∙

research

∙ 12/15/2020

Object-Centric Neural Scene Rendering

We present a method for composing photorealistic scenes from captured im...

Michelle Guo, et al. ∙

research

∙ 12/02/2020

pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesis

We have witnessed rapid progress on 3D-aware image synthesis, leveraging...

Eric R. Chan, et al. ∙

research

∙ 11/19/2020

Multi-Plane Program Induction with 3D Box Priors

We consider two important aspects in understanding and editing images: m...

Yikai Li, et al. ∙

research

∙ 11/03/2020

Learning 3D Dynamic Scene Representations for Robot Manipulation

3D scene representation for robot manipulation should capture three key ...

Zhenjia Xu, et al. ∙

research

∙ 09/24/2020

Multi-Frame to Single-Frame: Knowledge Distillation for 3D Object Detection

A common dilemma in 3D object detection for autonomous driving is that h...

Yue Wang, et al. ∙

research

∙ 07/24/2020

Unsupervised Discovery of 3D Physical Objects from Video

We study the problem of unsupervised physical object discovery. Unlike e...

Yilun Du, et al. ∙

research

∙ 07/23/2020

End-to-End Optimization of Scene Layout

We propose an end-to-end variational generative model for scene layout s...

Andrew Luo, et al. ∙

research

∙ 06/25/2020

Perspective Plane Program Induction from a Single Image

We study the inverse graphics problem of inferring a holistic representa...

Yikai Li, et al. ∙

research

∙ 06/22/2020

Learning Physical Graph Representations from Visual Scenes

Convolutional Neural Networks (CNNs) have proved exceptional at learning...

Daniel M. Bear, et al. ∙

research

∙ 06/10/2020

When is Particle Filtering Efficient for POMDP Sequential Planning?

Particle filtering is a popular method for inferring latent states in st...

Simon S. Du, et al. ∙

research

∙ 05/18/2020

Data Represention for Deep Learning with Priori Knowledge of Symmetric Wireless Tasks

Deep neural networks (DNNs) have been applied to address various wireles...

Chengjian Sun, et al. ∙

research

∙ 04/28/2020

Visual Grounding of Learned Physical Models

Humans intuitively recognize objects' physical properties and predict th...

Yunzhu Li, et al. ∙

research

∙ 02/04/2020

Visual Concept-Metaconcept Learning

Humans reason with concepts and metaconcepts: we recognize red and green...

Chi Han, et al. ∙

research

∙ 12/25/2019

Look, Listen, and Act: Towards Audio-Visual Embodied Navigation

A crucial aspect of mobile intelligent agents is their ability to integr...

Chuang Gan, et al. ∙

research

∙ 11/08/2019

Accurate Vision-based Manipulation through Contact Reasoning

Planning contact interactions is one of the core challenges of many robo...

Alina Kloss, et al. ∙

research

∙ 10/29/2019

Proactive Optimization with Unsupervised Learning

Proactive resource allocation, say proactive caching at wireless edge, h...

Jiajun Wu, et al. ∙

research

∙ 10/28/2019

Entity Abstraction in Visual Model-Based Reinforcement Learning

This paper tests the hypothesis that modeling a scene in terms of entiti...

Rishi Veerapaneni, et al. ∙

research

∙ 10/18/2019

Learning Compositional Koopman Operators for Model-Based Control

Finding an embedding space for a linear approximation of a nonlinear dyn...

Yunzhu Li, et al. ∙

research

∙ 10/03/2019

CLEVRER: CoLlision Events for Video REpresentation and Reasoning

The ability to reason about temporal and causal events from videos lies ...

Kexin Yi, et al. ∙

research

∙ 09/28/2019

Dual Sequential Monte Carlo: Tunneling Filtering and Planning in Continuous POMDPs

We present the DualSMC network that solves continuous POMDPs by learning...

Yunbo Wang, et al. ∙

research

∙ 09/04/2019

Program-Guided Image Manipulators

Humans are capable of building holistic representations for images at va...

Jiayuan Mao, et al. ∙

research

∙ 06/17/2019

Neurally-Guided Structure Inference

Most structure inference methods either rely on exhaustive search or are...

Sidi Lu, et al. ∙

research

∙ 06/10/2019

DensePhysNet: Learning Dense Physical Object Representations via Multi-step Dynamic Interactions

We study the problem of learning physical object representations for rob...

Zhenjia Xu, et al. ∙

research

∙ 04/26/2019

The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervision

We propose the Neuro-Symbolic Concept Learner (NS-CL), a model that lear...

Jiayuan Mao, et al. ∙

research

∙ 04/13/2019

Combining Physical Simulators and Object-Based Networks for Control

Physics engines play an important role in robot planning and control; ho...

Anurag Ajay, et al. ∙

research

∙ 03/12/2019

Unsupervised Discovery of Parts, Structure, and Dynamics

Humans easily recognize object parts and their hierarchical structure by...

Zhenjia Xu, et al. ∙

Jiajun Wu

Featured Co-authors