b'Siyuan Huang'

research

∙ 09/19/2023

Bridging Zero-shot Object Navigation and Foundation Models through Pixel-Guided Navigation Skill

Zero-shot object navigation is a challenging task for home-assistance ro...

0 Wenzhe Cai, et al. ∙

research

∙ 08/08/2023

3D-VisTA: Pre-trained Transformer for 3D Vision and Text Alignment

3D vision-language grounding (3D-VL) is an emerging field that aims to c...

0 Ziyu Zhu, et al. ∙

research

∙ 08/07/2023

Tiny LVLM-eHub: Early Multimodal Experiments with Bard

Recent advancements in Large Vision-Language Models (LVLMs) have demonst...

0 Wenqi Shao, et al. ∙

research

∙ 06/15/2023

LVLM-eHub: A Comprehensive Evaluation Benchmark for Large Vision-Language Models

Large Vision-Language Models (LVLMs) have recently played a dominant rol...

0 Peng Xu, et al. ∙

research

∙ 05/18/2023

Instruct2Act: Mapping Multi-modality Instructions to Robotic Actions with Large Language Model

Foundation models have made significant strides in various applications,...

3 Siyuan Huang, et al. ∙

research

∙ 05/16/2023

SUG: Single-dataset Unified Generalization for 3D Point Cloud Classification

Although Domain Generalization (DG) problem has been fast-growing in the...

0 Siyuan Huang, et al. ∙

research

∙ 04/09/2023

ARNOLD: A Benchmark for Language-Grounded Task Learning With Continuous States in Realistic 3D Scenes

Understanding the continuous states of objects is essential for task lea...

0 Ran Gong, et al. ∙

research

∙ 03/03/2023

Prompt, Generate, then Cache: Cascade of Foundation Models makes Strong Few-shot Learners

Visual recognition in low-data regimes requires deep neural networks to ...

0 Renrui Zhang, et al. ∙

research

∙ 01/15/2023

Diffusion-based Generation, Optimization, and Planning in 3D Scenes

We introduce SceneDiffuser, a conditional generative model for 3D scene ...

0 Siyuan Huang, et al. ∙

research

∙ 12/20/2022

ADAS: A Simple Active-and-Adaptive Baseline for Cross-Domain 3D Semantic Segmentation

State-of-the-art 3D semantic segmentation models are trained on the off-...

0 Ben Fei, et al. ∙

research

∙ 11/28/2022

Perceive, Ground, Reason, and Act: A Benchmark for General-purpose Visual Representation

Current computer vision models, unlike the human visual system, cannot y...

0 Jiangyong Huang, et al. ∙

research

∙ 10/18/2022

HUMANISE: Language-conditioned Human Motion Generation in 3D Scenes

Learning to generate diverse scene-aware and goal-oriented human motions...

30 Zan Wang, et al. ∙

research

∙ 10/17/2022

Unsupervised Object-Centric Learning with Bi-Level Optimized Query Slot Attention

The ability to decompose complex natural scenes into meaningful object-c...

13 Baoxiong Jia, et al. ∙

research

∙ 10/14/2022

SQA3D: Situated Question Answering in 3D Scenes

We propose a new task to benchmark scene understanding of embodied agent...

13 Xiaojian Ma, et al. ∙

research

∙ 10/08/2022

EgoTaskQA: Understanding Human Tasks in Egocentric Videos

Understanding human tasks through video observations is an essential cap...

0 Baoxiong Jia, et al. ∙

research

∙ 05/12/2022

Infrared Invisible Clothing:Hiding from Infrared Detectors at Multiple Angles in Real World

Thermal infrared imaging is widely used in body temperature measurement,...

0 Xiaopei Zhu, et al. ∙

research

∙ 03/07/2022

Adversarial Texture for Fooling Person Detectors in the Physical World

Nowadays, cameras equipped with AI systems can capture and analyze image...

0 Zhanhao Hu, et al. ∙

research

∙ 09/08/2021

YouRefIt: Embodied Reference Understanding with Language and Gesture

We study the understanding of embodied reference: One agent uses both la...

0 Yixin Chen, et al. ∙

research

∙ 09/01/2021

Spatio-temporal Self-Supervised Representation Learning for 3D Point Clouds

To date, various 3D scene understanding tasks still lack practical and g...

0 Siyuan Huang, et al. ∙

research

∙ 05/10/2021

Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoning

Geometry problem solving has attracted much attention in the NLP communi...

13 Pan Lu @ UCLA, et al. ∙

research

∙ 04/04/2021

Learning Neural Representation of Camera Pose with Matrix Representation of Pose Shift via View Synthesis

How to effectively represent camera pose is an essential problem in 3D c...

12 Yaxuan Zhu, et al. ∙

research

∙ 03/24/2021

VLGrammar: Grounded Grammar Induction of Vision and Language

Cognitive grammar suggests that the acquisition of language grammar is g...

0 Yining Hong, et al. ∙

research

∙ 12/27/2020

SMART: A Situation Model for Algebra Story Problems via Attributed Grammar

Solving algebra story problems remains a challenging task in artificial ...

0 Yining Hong, et al. ∙

research

∙ 07/31/2020

LEMMA: A Multi-view Dataset for Learning Multi-agent Multi-task Activities

Understanding and interpreting human actions is a long-standing challeng...

0 Baoxiong Jia, et al. ∙

research

∙ 07/03/2020

A Competence-aware Curriculum for Visual Concepts Learning via Question Answering

Humans can progressively learn visual concepts from easy to hard questio...

8 Qing Li, et al. ∙

research

∙ 06/11/2020

Closed Loop Neural-Symbolic Learning via Integrating Neural Perception, Grammar Parsing, and Symbolic Reasoning

The goal of neural-symbolic computation is to integrate the connectionis...

16 Qing Li, et al. ∙

research

∙ 04/25/2020

Memory-efficient training with streaming dimensionality reduction

The movement of large quantities of data during the training of a Deep N...

52 Siyuan Huang, et al. ∙

research

∙ 04/20/2020

Dark, Beyond Deep: A Paradigm Shift to Cognitive AI with Humanlike Common Sense

Recent progress in deep learning is essentially based on a "big data for...

10 Yixin Zhu, et al. ∙

research

∙ 12/16/2019

PerspectiveNet: 3D Object Detection from a Single RGB Image via Perspective Points

Detecting 3D objects from a single RGB image is intrinsically ambiguous,...

20 Siyuan Huang, et al. ∙

research

∙ 09/04/2019

Understanding Human Gaze Communication by Spatio-Temporal Graph Reasoning

This paper addresses a new problem of understanding human gaze communica...

7 Lifeng Fan, et al. ∙

research

∙ 09/04/2019

Holistic++ Scene Understanding: Single-view 3D Holistic Scene Parsing and Human Pose Estimation with Human-Object Interaction and Physical Commonsense

We propose a new 3D holistic++ scene understanding problem, which jointl...

26 Yixin Chen, et al. ∙

research

∙ 03/05/2019

Streaming Batch Eigenupdates for Hardware Neuromorphic Networks

Neuromorphic networks based on nanodevices, such as metal oxide memristo...

0 Brian D. Hoskins, et al. ∙

research

∙ 10/31/2018

Cooperative Holistic Scene Understanding: Unifying 3D Object, Layout, and Camera Pose Estimation

Holistic 3D indoor scene understanding refers to jointly recovering the ...

0 Siyuan Huang, et al. ∙

research

∙ 08/25/2018

Human-centric Indoor Scene Synthesis Using Stochastic Grammar

We present a human-centric method to sample and synthesize 3D room layou...

0 Siyuan Qi, et al. ∙

research

∙ 08/07/2018

Holistic 3D Scene Parsing and Reconstruction from a Single RGB Image

We propose a computational framework to jointly parse a single RGB image...

2 Siyuan Huang, et al. ∙

research

∙ 08/02/2017

Predicting Human Activities Using Stochastic Grammar

This paper presents a novel method to predict future human activities fr...

0 Siyuan Qi, et al. ∙

research

∙ 04/01/2017

Configurable, Photorealistic Image Rendering and Ground Truth Synthesis by Sampling Stochastic Grammars Representing Indoor Scenes

We propose the configurable rendering of massive quantities of photoreal...

0 Chenfanfu Jiang, et al. ∙

Siyuan Huang

Featured Co-authors