b'Yixin Zhu'

research

∙ 08/21/2023

X-VoE: Measuring eXplanatory Violation of Expectation in Physical Events

Intuitive physics is pivotal for human understanding of the physical wor...

0 Bo Dai, et al. ∙

research

∙ 07/31/2023

Part-level Scene Reconstruction Affords Robot Interaction

Existing methods for reconstructing interactive scenes primarily focus o...

0 Zeyu Zhang, et al. ∙

research

∙ 07/13/2023

Making the Most Out of the Limited Context Length: Predictive Power Varies with Clinical Note Type and Note Section

Recent advances in large language models have led to renewed interest in...

0 Hongyi Zheng, et al. ∙

research

∙ 06/25/2023

Sequential Manipulation Planning for Over-actuated UAMs

We investigate the sequential manipulation planning problem for unmanned...

0 Yao Su, et al. ∙

research

∙ 06/01/2023

MEWL: Few-shot multimodal word learning with referential uncertainty

Without explicit feedback, humans can rapidly learn the meaning of words...

0 Guangyuan Jiang, et al. ∙

research

∙ 04/17/2023

STRAP: Structured Object Affordance Segmentation with Point Supervision

With significant annotation savings, point supervision has been proven e...

0 Leiyao Cui, et al. ∙

research

∙ 01/15/2023

Diffusion-based Generation, Optimization, and Planning in 3D Scenes

We introduce SceneDiffuser, a conditional generative model for 3D scene ...

0 Siyuan Huang, et al. ∙

research

∙ 01/14/2023

A Reconfigurable Data Glove for Reconstructing Physical and Virtual Grasps

In this work, we present a reconfigurable data glove design to capture d...

0 Hangxin Liu, et al. ∙

research

∙ 12/01/2022

To think inside the box, or to think out of the box? Scientific discovery via the reciprocation of insights and concepts

If scientific discovery is one of the main driving forces of human progr...

0 Yu-Zhe Shi, et al. ∙

research

∙ 10/18/2022

HUMANISE: Language-conditioned Human Motion Generation in 3D Scenes

Learning to generate diverse scene-aware and goal-oriented human motions...

30 Zan Wang, et al. ∙

research

∙ 10/05/2022

On the Learning Mechanisms in Physical Reasoning

Is dynamics prediction indispensable for physical reasoning? If so, what...

0 Shiqian Li, et al. ∙

research

∙ 07/10/2022

Sequential Manipulation Planning on Scene Graph

We devise a 3D scene graph representation, contact graph+ (cg+), for eff...

0 Ziyuan Jiao, et al. ∙

research

∙ 06/18/2022

EST: Evaluating Scientific Thinking in Artificial Agents

Theoretical ideas and empirical research have shown us a seemingly surpr...

0 Manjie Xu, et al. ∙

research

∙ 01/12/2022

Object Gathering with a Tethered Robot Duo

We devise a cooperative planning framework to generate optimal trajector...

0 Yao Su, et al. ∙

research

∙ 11/28/2021

Emergent Graphical Conventions in a Visual Communication Game

Humans communicate with graphical sketches apart from symbolic languages...

0 Shuwen Qiu, et al. ∙

research

∙ 09/08/2021

YouRefIt: Embodied Reference Understanding with Language and Gesture

We study the understanding of embodied reference: One agent uses both la...

0 Yixin Chen, et al. ∙

research

∙ 09/01/2021

Spatio-temporal Self-Supervised Representation Learning for 3D Point Clouds

To date, various 3D scene understanding tasks still lack practical and g...

0 Siyuan Huang, et al. ∙

research

∙ 08/05/2021

Communicative Learning with Natural Gestures for Embodied Navigation Agents with Human-in-the-Scene

Human-robot collaboration is an essential research topic in artificial i...

10 Qi Wu, et al. ∙

research

∙ 08/03/2021

Consolidating Kinematic Models to Promote Coordinated Mobile Manipulations

We construct a Virtual Kinematic Chain (VKC) that readily consolidates t...

0 Ziyuan Jiao, et al. ∙

research

∙ 06/03/2021

Individual vs. Joint Perception: a Pragmatic Model of Pointing as Communicative Smithian Helping

The simple gesture of pointing can greatly augment ones ability to compr...

2 Kaiwen Jiang, et al. ∙

research

∙ 04/19/2021

Synthesizing Diverse and Physically Stable Grasps with Arbitrary Hand Structures by Differentiable Force Closure Estimation

Existing grasp synthesis methods are either analytical or data-driven. T...

0 Tengyu Liu, et al. ∙

research

∙ 04/07/2021

Learning Triadic Belief Dynamics in Nonverbal Communication from Videos

Humans possess a unique social cognition capability; nonverbal communica...

0 Lifeng Fan, et al. ∙

research

∙ 03/30/2021

Reconstructing Interactive 3D Scenes by Panoptic Mapping and CAD Model Alignments

In this paper, we rethink the problem of scene reconstruction from an em...

0 Muzhi Han, et al. ∙

research

∙ 03/26/2021

ACRE: Abstract Causal REasoning Beyond Covariation

Causal induction, i.e., identifying unobservable mechanisms that lead to...

0 Chi Zhang, et al. ∙

research

∙ 03/26/2021

Abstract Spatial-Temporal Reasoning via Probabilistic Abduction and Execution

Spatial-temporal reasoning is a challenging task in Artificial Intellige...

0 Chi Zhang, et al. ∙

research

∙ 01/07/2021

Incorporating Vision Bias into Click Models for Image-oriented Search Engine

Most typical click models assume that the probability of a document to b...

4 Ningxin Xu, et al. ∙

research

∙ 07/31/2020

LEMMA: A Multi-view Dataset for Learning Multi-agent Multi-task Activities

Understanding and interpreting human actions is a long-standing challeng...

0 Baoxiong Jia, et al. ∙

research

∙ 07/24/2020

Human-Robot Interaction in a Shared Augmented Reality Workspace

We design and develop a new shared Augmented Reality (AR) workspace for ...

0 Shuwen Qiu, et al. ∙

research

∙ 04/25/2020

Joint Inference of States, Robot Knowledge, and Human (False-)Beliefs

Aiming to understand how human (false-)belief–a core socio-cognitive abi...

2 Tao Yuan, et al. ∙

research

∙ 04/25/2020

Congestion-aware Evacuation Routing using Augmented Reality Devices

We present a congestion-aware routing solution for indoor evacuation, wh...

0 Zeyu Zhang, et al. ∙

research

∙ 04/25/2020

Machine Number Sense: A Dataset of Visual Arithmetic Problems for Abstract and Relational Reasoning

As a comprehensive indicator of mathematical thinking and intelligence, ...

8 Wenhe Zhang, et al. ∙

research

∙ 04/20/2020

Dark, Beyond Deep: A Paradigm Shift to Cognitive AI with Humanlike Common Sense

Recent progress in deep learning is essentially based on a "big data for...

10 Yixin Zhu, et al. ∙

research

∙ 03/02/2020

A Hybrid Lagrangian-Eulerian Method for Topology Optimization

We propose LETO, a new hybrid Lagrangian-Eulerian method for topology op...

0 Yue Li, et al. ∙

research

∙ 12/16/2019

PerspectiveNet: 3D Object Detection from a Single RGB Image via Perspective Points

Detecting 3D objects from a single RGB image is intrinsically ambiguous,...

20 Siyuan Huang, et al. ∙

research

∙ 11/29/2019

Learning Perceptual Inference by Contrasting

"Thinking in pictures," [1] i.e., spatial-temporal reasoning, effortless...

0 Chi Zhang, et al. ∙

research

∙ 11/25/2019

Theory-based Causal Transfer: Integrating Instance-level Induction and Abstract-level Structure Learning

Learning transferable knowledge across similar but different settings is...

0 Mark Edmonds, et al. ∙

research

∙ 09/04/2019

Holistic++ Scene Understanding: Single-view 3D Holistic Scene Parsing and Human Pose Estimation with Human-Object Interaction and Physical Commonsense

We propose a new 3D holistic++ scene understanding problem, which jointl...

26 Yixin Chen, et al. ∙

research

∙ 04/02/2019

VRGym: A Virtual Testbed for Physical and Interactive AI

We propose VRGym, a virtual reality testbed for realistic human-robot in...

0 Xu Xie, et al. ∙

research

∙ 03/07/2019

RAVEN: A Dataset for Relational and Analogical Visual rEasoNing

Dramatic progress has been witnessed in basic vision tasks involving low...

0 Chi Zhang, et al. ∙

research

∙ 12/13/2018

MetaStyle: Three-Way Trade-Off Among Speed, Flexibility, and Quality in Neural Style Transfer

An unprecedented booming has been witnessed in the research area of arti...

2 Chi Zhang, et al. ∙

research

∙ 10/31/2018

Cooperative Holistic Scene Understanding: Unifying 3D Object, Layout, and Camera Pose Estimation

Holistic 3D indoor scene understanding refers to jointly recovering the ...

0 Siyuan Huang, et al. ∙

research

∙ 08/25/2018

Human-centric Indoor Scene Synthesis Using Stochastic Grammar

We present a human-centric method to sample and synthesize 3D room layou...

0 Siyuan Qi, et al. ∙

research

∙ 08/07/2018

Holistic 3D Scene Parsing and Reconstruction from a Single RGB Image

We propose a computational framework to jointly parse a single RGB image...

2 Siyuan Huang, et al. ∙

research

∙ 04/01/2017

Configurable, Photorealistic Image Rendering and Ground Truth Synthesis by Sampling Stochastic Grammars Representing Indoor Scenes

We propose the configurable rendering of massive quantities of photoreal...

0 Chenfanfu Jiang, et al. ∙

Yixin Zhu

Featured Co-authors