b'Jiajun Wu'

research

∙ 05/08/2022

Unsupervised Discovery and Composition of Object Light Fields

Neural scene representations, both continuous and discrete, have recentl...

5 Cameron Smith, et al. ∙

research

∙ 05/05/2022

RoboCraft: Learning to See, Simulate, and Shape Elasto-Plastic Objects with Graph Networks

Modeling and manipulating elasto-plastic objects are essential capabilit...

12 Haochen Shi, et al. ∙

research

∙ 05/04/2022

Video Extrapolation in Space and Time

Novel view synthesis (NVS) and video prediction (VP) are typically consi...

3 Yunzhi Zhang, et al. ∙

research

∙ 04/28/2022

Rotationally Equivariant 3D Object Detection

Rotation equivariance has recently become a strongly desired property in...

24 Hong-Xing Yu, et al. ∙

research

∙ 04/05/2022

ObjectFolder 2.0: A Multisensory Object Dataset for Sim2Real Transfer

Objects play a crucial role in our everyday activities. Though multisens...

4 Ruohan Gao, et al. ∙

research

∙ 03/15/2022

Vision-Based Manipulators Need to Also See from Their Hands

We study how the choice of visual perspective affects learning and gener...

1 Kyle Hsu, et al. ∙

research

∙ 02/17/2022

Grammar-Based Grounded Lexicon Learning

We present Grammar-Based Grounded Lexicon Learning (G2L2), a lexicalist ...

0 Jiayuan Mao, et al. ∙

research

∙ 09/16/2021

ObjectFolder: A Dataset of Objects with Implicit Visual, Auditory, and Tactile Representations

Multisensory object-centric perception, reasoning, and interaction have ...

9 Ruohan Gao, et al. ∙

research

∙ 08/28/2021

DASH: Modularized Human Manipulation Simulation with Vision and Language for Embodied AI

Creating virtual humans with embodied, human-like perceptual and actuati...

11 Yifeng Jiang, et al. ∙

research

∙ 08/06/2021

BEHAVIOR: Benchmark for Everyday Household Activities in Virtual, Interactive, and Ecological Environments

We introduce BEHAVIOR, a benchmark for embodied AI with 100 activities i...

10 Sanjana Srivastava, et al. ∙

research

∙ 08/06/2021

iGibson 2.0: Object-Centric Simulation for Robot Learning of Everyday Household Tasks

Recent research in embodied AI has been boosted by the use of simulation...

18 Chengshu Li, et al. ∙

research

∙ 07/16/2021

Unsupervised Discovery of Object Radiance Fields

We study the problem of inferring an object-centric scene representation...

1 Hong-Xing Yu, et al. ∙

research

∙ 06/10/2021

Temporal and Object Quantification Networks

We present Temporal and Object Quantification Networks (TOQ-Nets), a new...

3 Jiayuan Mao, et al. ∙

research

∙ 04/22/2021

KeypointDeformer: Unsupervised 3D Keypoint Discovery for Shape Control

We introduce KeypointDeformer, a novel unsupervised method for shape con...

11 Tomas Jakab, et al. ∙

research

∙ 04/22/2021

Hierarchical Motion Understanding via Motion Programs

Current approaches to video analysis of human motion focus on raw pixels...

6 Sumith Kulal, et al. ∙

research

∙ 04/08/2021

De-rendering the World's Revolutionary Artefacts

Recent works have shown exciting results in unsupervised image de-render...

4 Shangzhe Wu, et al. ∙

research

∙ 04/08/2021

3D Shape Generation and Completion through Point-Voxel Diffusion

We propose a novel approach for probabilistic generative modeling of 3D ...

2 Linqi Zhou, et al. ∙

research

∙ 03/30/2021

Grounding Physical Concepts of Objects and Events Through Dynamic Visual Reasoning

We study the problem of dynamic visual reasoning on raw videos. This is ...

5 Zhenfang Chen, et al. ∙

research

∙ 03/30/2021

Repopulating Street Scenes

We present a framework for automatically reconfiguring images of street ...

13 Yifan Wang, et al. ∙

research

∙ 01/07/2021

Learning Temporal Dynamics from Cycles in Narrated Video

Learning to model how the world changes as time elapses has proven a cha...

2 Dave Epstein, et al. ∙

research

∙ 12/31/2020

Language-Mediated, Object-Centric Representation Learning

We present Language-mediated, Object-centric Representation Learning (LO...

12 Ruocheng Wang, et al. ∙

research

∙ 12/23/2020

Augmenting Policy Learning with Routines Discovered from a Single Demonstration

Humans can abstract prior knowledge from very little data and use it to ...

6 Zelin Zhao, et al. ∙

research

∙ 12/21/2020

Object-Centric Diagnosis of Visual Reasoning

When answering questions about an image, it not only needs knowing what ...

1 Jianwei Yang, et al. ∙

research

∙ 12/17/2020

Neural Radiance Flow for 4D View Synthesis and Video Processing

We present a method, Neural Radiance Flow (NeRFlow),to learn a 4D spatia...

2 Yilun Du, et al. ∙

research

∙ 12/15/2020

Object-Centric Neural Scene Rendering

We present a method for composing photorealistic scenes from captured im...

8 Michelle Guo, et al. ∙

research

∙ 12/02/2020

pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesis

We have witnessed rapid progress on 3D-aware image synthesis, leveraging...

14 Eric R. Chan, et al. ∙

research

∙ 11/19/2020

Multi-Plane Program Induction with 3D Box Priors

We consider two important aspects in understanding and editing images: m...

0 Yikai Li, et al. ∙

research

∙ 11/03/2020

Learning 3D Dynamic Scene Representations for Robot Manipulation

3D scene representation for robot manipulation should capture three key ...

2 Zhenjia Xu, et al. ∙

research

∙ 09/24/2020

Multi-Frame to Single-Frame: Knowledge Distillation for 3D Object Detection

A common dilemma in 3D object detection for autonomous driving is that h...

0 Yue Wang, et al. ∙

research

∙ 07/24/2020

Unsupervised Discovery of 3D Physical Objects from Video

We study the problem of unsupervised physical object discovery. Unlike e...

7 Yilun Du, et al. ∙

research

∙ 07/23/2020

End-to-End Optimization of Scene Layout

We propose an end-to-end variational generative model for scene layout s...

11 Andrew Luo, et al. ∙

research

∙ 06/25/2020

Perspective Plane Program Induction from a Single Image

We study the inverse graphics problem of inferring a holistic representa...

8 Yikai Li, et al. ∙

research

∙ 06/22/2020

Learning Physical Graph Representations from Visual Scenes

Convolutional Neural Networks (CNNs) have proved exceptional at learning...

10 Daniel M. Bear, et al. ∙

research

∙ 06/10/2020

When is Particle Filtering Efficient for POMDP Sequential Planning?

Particle filtering is a popular method for inferring latent states in st...

1 Simon S. Du, et al. ∙

research

∙ 05/18/2020

Data Represention for Deep Learning with Priori Knowledge of Symmetric Wireless Tasks

Deep neural networks (DNNs) have been applied to address various wireles...

0 Chengjian Sun, et al. ∙

research

∙ 04/28/2020

Visual Grounding of Learned Physical Models

Humans intuitively recognize objects' physical properties and predict th...

2 Yunzhu Li, et al. ∙

research

∙ 02/04/2020

Visual Concept-Metaconcept Learning

Humans reason with concepts and metaconcepts: we recognize red and green...

1 Chi Han, et al. ∙

research

∙ 12/25/2019

Look, Listen, and Act: Towards Audio-Visual Embodied Navigation

A crucial aspect of mobile intelligent agents is their ability to integr...

2 Chuang Gan, et al. ∙

research

∙ 11/08/2019

Accurate Vision-based Manipulation through Contact Reasoning

Planning contact interactions is one of the core challenges of many robo...

18 Alina Kloss, et al. ∙

research

∙ 10/29/2019

Proactive Optimization with Unsupervised Learning

Proactive resource allocation, say proactive caching at wireless edge, h...

0 Jiajun Wu, et al. ∙

research

∙ 10/28/2019

Entity Abstraction in Visual Model-Based Reinforcement Learning

This paper tests the hypothesis that modeling a scene in terms of entiti...

33 Rishi Veerapaneni, et al. ∙

research

∙ 10/18/2019

Learning Compositional Koopman Operators for Model-Based Control

Finding an embedding space for a linear approximation of a nonlinear dyn...

0 Yunzhu Li, et al. ∙

research

∙ 10/03/2019

CLEVRER: CoLlision Events for Video REpresentation and Reasoning

The ability to reason about temporal and causal events from videos lies ...

12 Kexin Yi, et al. ∙

research

∙ 09/28/2019

Dual Sequential Monte Carlo: Tunneling Filtering and Planning in Continuous POMDPs

We present the DualSMC network that solves continuous POMDPs by learning...

15 Yunbo Wang, et al. ∙

research

∙ 09/04/2019

Program-Guided Image Manipulators

Humans are capable of building holistic representations for images at va...

4 Jiayuan Mao, et al. ∙

research

∙ 06/17/2019

Neurally-Guided Structure Inference

Most structure inference methods either rely on exhaustive search or are...

2 Sidi Lu, et al. ∙

research

∙ 06/10/2019

DensePhysNet: Learning Dense Physical Object Representations via Multi-step Dynamic Interactions

We study the problem of learning physical object representations for rob...

13 Zhenjia Xu, et al. ∙

research

∙ 04/26/2019

The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervision

We propose the Neuro-Symbolic Concept Learner (NS-CL), a model that lear...

12 Jiayuan Mao, et al. ∙

research

∙ 04/13/2019

Combining Physical Simulators and Object-Based Networks for Control

Physics engines play an important role in robot planning and control; ho...

0 Anurag Ajay, et al. ∙

research

∙ 03/12/2019

Unsupervised Discovery of Parts, Structure, and Dynamics

Humans easily recognize object parts and their hierarchical structure by...

12 Zhenjia Xu, et al. ∙

Jiajun Wu

Featured Co-authors