research
∙
09/18/2023
MindAgent: Emergent Gaming Interaction
Large Language Models (LLMs) have the capacity of performing complex sch...
share
research
∙
06/27/2023
MindDial: Belief Dynamics Tracking with Theory-of-Mind Modeling for Situated Neural Dialogue Generation
Humans talk in free-form while negotiating the expressed meanings or com...
research
∙
06/15/2023
DiPlomat: A Dialogue Dataset for Situated Pragmatic Reasoning
Pragmatic reasoning plays a pivotal role in deciphering implicit meaning...
research
∙
06/04/2023
MoviePuzzle: Visual Narrative Reasoning through Multimodal Order Learning
We introduce MoviePuzzle, a novel challenge that targets visual narrativ...
research
∙
05/30/2023
Shuo Wen Jie Zi: Rethinking Dictionaries and Glyphs for Chinese Language Pre-training
We introduce CDBERT, a new learning paradigm that enhances the semantics...
research
∙
05/30/2023
VSTAR: A Video-grounded Dialogue Dataset for Situated Semantic Understanding with Scene and Topic Transitions
Video-grounded dialogue understanding is a challenging problem that requ...
research
∙
05/24/2023
Large Language Models are In-Context Semantic Reasoners rather than Symbolic Reasoners
The emergent few-shot reasoning capabilities of Large Language Models (L...
research
∙
12/17/2022
Joint Information Extraction with Cross-Task and Cross-Instance High-Order Modeling
Prior works on Information Extraction (IE) typically predict different t...
research
∙
10/14/2022
SQA3D: Situated Question Answering in 3D Scenes
We propose a new task to benchmark scene understanding of embodied agent...
research
∙
09/07/2022
VGStore: A Multimodal Extension to SPARQL for Querying RDF Scene Graph
Semantic Web technology has successfully facilitated many RDF models wit...
research
∙
03/27/2022
Unsupervised Vision-Language Parsing: Seamlessly Bridging Visual Scene Graphs with Language Structures via Dependency Relationships
Understanding realistic visual scene images together with language descr...
research
∙
06/25/2021
Energy-Based Generative Cooperative Saliency Prediction
Conventional saliency prediction models typically learn a deterministic ...
research
∙
05/19/2021
Patchwise Generative ConvNet: Training Energy-Based Models from a Single Natural Image for Internal Learning
Exploiting internal statistics of a single natural image has long been r...
research
∙
04/07/2021
Learning Triadic Belief Dynamics in Nonverbal Communication from Videos
Humans possess a unique social cognition capability; nonverbal communica...
research
∙
12/29/2020
Learning Energy-Based Model with Variational Auto-Encoder as Amortized Sampler
Due to the intractable partition function, training energy-based models ...
research
∙
04/25/2020
Joint Inference of States, Robot Knowledge, and Human (False-)Beliefs
Aiming to understand how human (false-)belief–a core socio-cognitive abi...
research
∙
04/02/2020
Generative PointNet: Energy-Based Learning on Unordered Point Sets for 3D Generation, Reconstruction and Classification
We propose a generative model of unordered point sets, such as point clo...
research
∙
11/26/2019
Motion-Based Generator Model: Unsupervised Disentanglement of Appearance, Trackable and Intrackable Motions in Dynamic Patterns
Dynamic patterns are characterized by complex spatial and motion pattern...
research
∙
04/11/2019
Reasoning Visual Dialogs with Structural and Partial Observations
We propose a novel model to address the task of Visual Dialog which exhi...
research
∙
02/07/2019
Multimodal Conditional Learning with Fast Thinking Policy-like Model and Slow Thinking Planner-like Model
This paper studies the supervised learning of the conditional distributi...
research
∙
12/27/2018
Learning Dynamic Generator Model by Alternating Back-Propagation Through Time
This paper studies the dynamic generator model for spatial-temporal proc...
research
∙
04/02/2018