b'Song-Chun Zhu'

research

∙ 09/18/2023

MindAgent: Emergent Gaming Interaction

Large Language Models (LLMs) have the capacity of performing complex sch...

0 Ran Gong, et al. ∙

research

∙ 08/21/2023

X-VoE: Measuring eXplanatory Violation of Expectation in Physical Events

Intuitive physics is pivotal for human understanding of the physical wor...

0 Bo Dai, et al. ∙

research

∙ 07/31/2023

Part-level Scene Reconstruction Affords Robot Interaction

Existing methods for reconstructing interactive scenes primarily focus o...

0 Zeyu Zhang, et al. ∙

research

∙ 07/07/2023

Brain in a Vat: On Missing Pieces Towards Artificial General Intelligence in Large Language Models

In this perspective paper, we first comprehensively review existing eval...

0 Yuxi Ma, et al. ∙

research

∙ 06/27/2023

MindDial: Belief Dynamics Tracking with Theory-of-Mind Modeling for Situated Neural Dialogue Generation

Humans talk in free-form while negotiating the expressed meanings or com...

0 Shuwen Qiu, et al. ∙

research

∙ 06/27/2023

Learning non-Markovian Decision-Making from State-only Sequences

Conventional imitation learning assumes access to the actions of demonst...

0 Aoyang Qin, et al. ∙

research

∙ 06/15/2023

DiPlomat: A Dialogue Dataset for Situated Pragmatic Reasoning

Pragmatic reasoning plays a pivotal role in deciphering implicit meaning...

0 Hengli Li, et al. ∙

research

∙ 05/24/2023

Large Language Models are In-Context Semantic Reasoners rather than Symbolic Reasoners

The emergent few-shot reasoning capabilities of Large Language Models (L...

0 Xiaojuan Tang, et al. ∙

research

∙ 04/09/2023

ARNOLD: A Benchmark for Language-Grounded Task Learning With Continuous States in Realistic 3D Scenes

Understanding the continuous states of objects is essential for task lea...

0 Ran Gong, et al. ∙

research

∙ 01/15/2023

Diffusion-based Generation, Optimization, and Planning in 3D Scenes

We introduce SceneDiffuser, a conditional generative model for 3D scene ...

0 Siyuan Huang, et al. ∙

research

∙ 01/14/2023

A Reconfigurable Data Glove for Reconstructing Physical and Virtual Grasps

In this work, we present a reconfigurable data glove design to capture d...

0 Hangxin Liu, et al. ∙

research

∙ 10/29/2022

Learning Probabilistic Models from Generator Latent Spaces with Hat EBM

This work proposes a method for using any generator network as the found...

9 Mitch Hill, et al. ∙

research

∙ 10/24/2022

RulE: Neural-Symbolic Knowledge Graph Reasoning with Rule Embedding

Knowledge graph (KG) reasoning is an important problem for knowledge gra...

0 Xiaojuan Tang, et al. ∙

research

∙ 10/14/2022

SQA3D: Situated Question Answering in 3D Scenes

We propose a new task to benchmark scene understanding of embodied agent...

13 Xiaojian Ma, et al. ∙

research

∙ 10/08/2022

EgoTaskQA: Understanding Human Tasks in Egocentric Videos

Understanding human tasks through video observations is an essential cap...

0 Baoxiong Jia, et al. ∙

research

∙ 09/20/2022

Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering

When answering a question, humans utilize the information available acro...

73 Pan Lu @ UCLA, et al. ∙

research

∙ 07/10/2022

Sequential Manipulation Planning on Scene Graph

We devise a 3D scene graph representation, contact graph+ (cg+), for eff...

0 Ziyuan Jiao, et al. ∙

research

∙ 06/23/2022

VRKitchen2.0-IndoorKit: A Tutorial for Augmented Indoor Scene Building in Omniverse

With the recent progress of simulations by 3D modeling software and game...

2 Yizhou Zhao, et al. ∙

research

∙ 06/18/2022

EST: Evaluating Scientific Thinking in Artificial Agents

Theoretical ideas and empirical research have shown us a seemingly surpr...

0 Manjie Xu, et al. ∙

research

∙ 05/24/2022

EBM Life Cycle: MCMC Strategies for Synthesis, Defense, and Density Modeling

This work presents strategies to learn an Energy-Based Model (EBM) accor...

5 Mitch Hill, et al. ∙

research

∙ 04/24/2022

RelViT: Concept-guided Vision Transformer for Visual Relational Reasoning

Reasoning about visual relationships is central to how humans interpret ...

6 Xiaojian Ma, et al. ∙

research

∙ 03/09/2022

Triangular Character Animation Sampling with Motion, Emotion, and Relation

Dramatic progress has been made in animating individual characters. Howe...

3 Yizhou Zhao, et al. ∙

research

∙ 01/26/2022

Attention cannot be an Explanation

Attention based explanations (viz. saliency maps), by providing interpre...

0 Arjun R Akula, et al. ∙

research

∙ 01/17/2022

Discourse Analysis for Evaluating Coherence in Video Paragraph Captions

Video paragraph captioning is the task of automatically generating a coh...

0 Arjun R Akula, et al. ∙

research

∙ 01/10/2022

Effective Representation to Capture Collaboration Behaviors between Explainer and User

An explainable AI (XAI) model aims to provide transparency (in the form ...

0 Arjun Akula, et al. ∙

research

∙ 12/12/2021

ValueNet: A New Dataset for Human Value Driven Dialogue System

Building a socially intelligent agent involves many challenges, one of w...

9 Liang Qiu, et al. ∙

research

∙ 11/28/2021

Emergent Graphical Conventions in a Visual Communication Game

Humans communicate with graphical sketches apart from symbolic languages...

0 Shuwen Qiu, et al. ∙

research

∙ 10/25/2021

IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoning

Current visual question answering (VQA) tasks mainly consider answering ...

2 Pan Lu @ UCLA, et al. ∙

research

∙ 09/30/2021

Emergence of Theory of Mind Collaboration in Multiagent Systems

Currently, in the study of multiagent systems, the intentions of agents ...

28 Luyao Yuan, et al. ∙

research

∙ 09/08/2021

YouRefIt: Embodied Reference Understanding with Language and Gesture

We study the understanding of embodied reference: One agent uses both la...

0 Yixin Chen, et al. ∙

research

∙ 09/03/2021

CX-ToM: Counterfactual Explanations with Theory-of-Mind for Enhancing Human Trust in Image Recognition Models

We propose CX-ToM, short for counterfactual explanations with theory-of ...

1 Arjun R Akula, et al. ∙

research

∙ 09/01/2021

Spatio-temporal Self-Supervised Representation Learning for 3D Point Clouds

To date, various 3D scene understanding tasks still lack practical and g...

0 Siyuan Huang, et al. ∙

research

∙ 08/03/2021

Consolidating Kinematic Models to Promote Coordinated Mobile Manipulations

We construct a Virtual Kinematic Chain (VKC) that readily consolidates t...

0 Ziyuan Jiao, et al. ∙

research

∙ 05/10/2021

Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoning

Geometry problem solving has attracted much attention in the NLP communi...

13 Pan Lu @ UCLA, et al. ∙

research

∙ 05/04/2021

VersaGNN: a Versatile accelerator for Graph neural networks

Graph Neural Network (GNN) is a promising approach for analyzing graph-s...

18 Feng Shi, et al. ∙

research

∙ 04/19/2021

Synthesizing Diverse and Physically Stable Grasps with Arbitrary Hand Structures by Differentiable Force Closure Estimation

Existing grasp synthesis methods are either analytical or data-driven. T...

0 Tengyu Liu, et al. ∙

research

∙ 04/07/2021

Learning Triadic Belief Dynamics in Nonverbal Communication from Videos

Humans possess a unique social cognition capability; nonverbal communica...

0 Lifeng Fan, et al. ∙

research

∙ 04/04/2021

Learning Neural Representation of Camera Pose with Matrix Representation of Pose Shift via View Synthesis

How to effectively represent camera pose is an essential problem in 3D c...

12 Yaxuan Zhu, et al. ∙

research

∙ 03/30/2021

Reconstructing Interactive 3D Scenes by Panoptic Mapping and CAD Model Alignments

In this paper, we rethink the problem of scene reconstruction from an em...

0 Muzhi Han, et al. ∙

research

∙ 03/26/2021

ACRE: Abstract Causal REasoning Beyond Covariation

Causal induction, i.e., identifying unobservable mechanisms that lead to...

0 Chi Zhang, et al. ∙

research

∙ 03/26/2021

Abstract Spatial-Temporal Reasoning via Probabilistic Abduction and Execution

Spatial-temporal reasoning is a challenging task in Artificial Intellige...

0 Chi Zhang, et al. ∙

research

∙ 03/24/2021

VLGrammar: Grounded Grammar Induction of Vision and Language

Cognitive grammar suggests that the acquisition of language grammar is g...

0 Yining Hong, et al. ∙

research

∙ 03/12/2021

Towards Socially Intelligent Agents with Mental State Transition and Human Utility

Building a socially intelligent agent involves many challenges, one of w...

10 Liang Qiu, et al. ∙

research

∙ 03/06/2021

Show Me What You Can Do: Capability Calibration on Reachable Workspace for Human-Robot Collaboration

Aligning humans' assessment of what a robot can do with its true capabil...

0 Xiaofeng Gao, et al. ∙

research

∙ 12/27/2020

SMART: A Situation Model for Algebra Story Problems via Attributed Grammar

Solving algebra story problems remains a challenging task in artificial ...

0 Yining Hong, et al. ∙

research

∙ 12/19/2020

Learning by Fixing: Solving Math Word Problems with Weak Supervision

Previous neural solvers of math word problems (MWPs) are learned with fu...

0 Yining Hong, et al. ∙

research

∙ 11/18/2020

Weighted Entropy Modification for Soft Actor-Critic

We generalize the existing principle of the maximum Shannon entropy in r...

0 Yizhou Zhao, et al. ∙

research

∙ 11/18/2020

Vertical-Horizontal Structured Attention for Generating Music with Chords

In this paper, we propose a lightweight music-generating model based on ...

0 Yizhou Zhao, et al. ∙

research

∙ 11/12/2020

Generalized Inverse Planning: Learning Lifted non-Markovian Utility for Generalizable Task Representation

In searching for a generalizable representation of temporally extended t...

0 Sirui Xie, et al. ∙

research

∙ 09/17/2020

Structured Attention for Unsupervised Dialogue Structure Induction

Inducing a meaningful structural representation from one or a set of dia...

5 Liang Qiu, et al. ∙

Song-Chun Zhu

Featured Co-authors