William Yang Wang

research

∙ 05/24/2023

LayoutGPT: Compositional Visual Planning and Generation with Large Language Models

Attaining a high degree of user controllability in visual generation oft...

6 Weixi Feng, et al. ∙

research

∙ 05/24/2023

ALGO: Synthesizing Algorithmic Programs with Generated Oracle Verifiers

Large language models (LLMs) excel at implementing code from functionali...

0 Kexun Zhang, et al. ∙

research

∙ 05/23/2023

Text-guided 3D Human Generation from 2D Collections

3D human modeling has been widely used for engaging interaction in gamin...

0 Tsu-Jui Fu, et al. ∙

research

∙ 05/23/2023

INSTRUCTSCORE: Towards Explainable Text Generation Evaluation with Automatic Feedback

The field of automatic evaluation of text generation made tremendous pro...

0 Wenda Xu, et al. ∙

research

∙ 05/23/2023

Let's Think Frame by Frame: Evaluating Video Chain of Thought with Video Infilling and Prediction

Despite constituting 65 underrepresented in generative AI research. Mean...

0 Vaishnavi Himakunthala, et al. ∙

research

∙ 05/23/2023

Mitigating Language Model Hallucination with Interactive Question-Knowledge Alignment

Despite the remarkable recent advances in language models, they still st...

0 Shuo Zhang, et al. ∙

research

∙ 05/23/2023

EDIS: Entity-Driven Image Search over Multimodal Web Content

Making image retrieval methods practical for real-world search applicati...

0 Siqi Liu, et al. ∙

research

∙ 05/18/2023

Collaborative Generative AI: Integrating GPT-k for Efficient Editing in Text-to-Image Generation

The field of text-to-image (T2I) generation has garnered significant att...

0 Wanrong Zhu, et al. ∙

research

∙ 05/18/2023

LLMScore: Unveiling the Power of Large Language Models in Text-to-Image Synthesis Evaluation

Existing automatic evaluation on text-to-image synthesis can only provid...

0 Yujie Lu, et al. ∙

research

∙ 05/18/2023

Discriminative Diffusion Models as Few-shot Vision and Language Learners

Diffusion models, such as Stable Diffusion, have shown incredible perfor...

0 Xuehai He, et al. ∙

research

∙ 05/18/2023

Data Augmentation for Diverse Voice Conversion in Noisy Environments

Voice conversion (VC) models have demonstrated impressive few-shot conve...

0 Avani Tanna, et al. ∙

research

∙ 05/03/2023

Visual Chain of Thought: Bridging Logical Gaps with Multimodal Infillings

Recent advances in large language models elicit reasoning in a chain of ...

0 Daniel Rose, et al. ∙

research

∙ 05/02/2023

Multimodal Procedural Planning via Dual Text-Image Prompting

Embodied agents have achieved prominent performance in following human i...

5 Yujie Lu, et al. ∙

research

∙ 03/09/2023

Users are the North Star for AI Transparency

Despite widespread calls for transparent artificial intelligence systems...

0 Alex Mei, et al. ∙

research

∙ 02/05/2023

ReDi: Efficient Learning-Free Diffusion Inference via Trajectory Retrieval

Diffusion models show promising generation capability for a variety of d...

0 Kexun Zhang, et al. ∙

research

∙ 01/27/2023

Large Language Models Are Implicitly Topic Models: Explaining and Finding Good Demonstrations for In-Context Learning

In recent years, pre-trained large language models have demonstrated rem...

1 Xinyi Wang, et al. ∙

research

∙ 01/21/2023

Dr.Spider: A Diagnostic Evaluation Benchmark towards Text-to-SQL Robustness

Neural text-to-SQL models have achieved remarkable performance in transl...

0 Shuaichen Chang, et al. ∙

research

∙ 12/19/2022

Tokenization Consistency Matters for Generative Models on Extractive NLP Tasks

Generative models have been widely applied to solve extractive tasks, wh...

0 Kaiser Sun, et al. ∙

research

∙ 12/19/2022

Foveate, Attribute, and Rationalize: Towards Safe and Trustworthy AI

Users' physical safety is an increasing concern as the market for intell...

0 Alex Mei, et al. ∙

research

∙ 12/19/2022

SEScore2: Retrieval Augmented Pretraining for Text Generation Evaluation

Is it possible to leverage large scale raw and raw parallel corpora to b...

0 Wenda Xu, et al. ∙

research

∙ 12/17/2022

Improving Cross-task Generalization of Unified Table-to-text Models with Compositional Task Configurations

There has been great progress in unifying various table-to-text tasks us...

0 Jifan Chen, et al. ∙

research

∙ 12/09/2022

Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesis

Large-scale diffusion models have achieved state-of-the-art results on t...

0 Weixi Feng, et al. ∙

research

∙ 11/23/2022

Tell Me What Happened: Unifying Text-guided Video Completion via Multimodal Masked Video Generation

Generating a video given the first several static frames is challenging ...

0 Tsu-Jui Fu, et al. ∙

research

∙ 10/25/2022

Bridging the Training-Inference Gap for Dense Phrase Retrieval

Building dense retrievers requires a series of standard procedures, incl...

0 Gyuwan Kim, et al. ∙

research

∙ 10/21/2022

WikiWhy: Answering and Explaining Cause-and-Effect Questions

As large language models (LLMs) grow larger and more sophisticated, asse...

2 Matthew Ho, et al. ∙

research

∙ 10/19/2022

CPL: Counterfactual Prompt Learning for Vision and Language Models

Prompt tuning is a new few-shot transfer learning technique that only tu...

0 Xuehai He, et al. ∙

research

∙ 10/18/2022

SafeText: A Benchmark for Exploring Physical Safety in Language Models

Understanding what constitutes safe text is an important issue in natura...

0 Sharon Levy, et al. ∙

research

∙ 10/18/2022

ULN: Towards Underspecified Vision-and-Language Navigation

Vision-and-Language Navigation (VLN) is a task to guide an embodied agen...

0 Weixi Feng, et al. ∙

research

∙ 10/17/2022

Mitigating Covertly Unsafe Text within Natural Language Systems

An increasingly prevalent problem for intelligent technologies is text s...

0 Alex Mei, et al. ∙

research

∙ 10/12/2022

Language Agnostic Multilingual Information Retrieval with Contrastive Learning

Multilingual information retrieval is challenging due to the lack of tra...

0 Xiyang Hu, et al. ∙

research

∙ 10/11/2022

CLIP also Understands Text: Prompting CLIP for Phrase Understanding

Contrastive Language-Image Pretraining (CLIP) efficiently learns visual ...

6 An Yan, et al. ∙

research

∙ 10/10/2022

Not All Errors are Equal: Learning Text Generation Metrics using Stratified Error Synthesis

Is it possible to build a general and automatic natural language generat...

15 Wenda Xu, et al. ∙

research

∙ 10/07/2022

ConvFinQA: Exploring the Chain of Numerical Reasoning in Conversational Finance Question Answering

With the recent advance in large pre-trained language models, researcher...

0 Zhiyu Chen, et al. ∙

research

∙ 10/07/2022

Visualize Before You Write: Imagination-Guided Open-Ended Text Generation

Recent advances in text-to-image synthesis make it possible to visualize...

4 Wanrong Zhu, et al. ∙

research

∙ 10/07/2022

Knowledge-Grounded Reinforcement Learning

Receiving knowledge, abiding by laws, and being aware of regulations are...

0 Zih-Yun Chiu, et al. ∙

research

∙ 10/07/2022

Atomized Deep Learning Models

Deep learning models often tackle the intra-sample structure, such as th...

0 Yi-Lin Tuan, et al. ∙

research

∙ 09/10/2022

Anticipating the Unseen Discrepancy for Vision and Language Navigation

Vision-Language Navigation requires the agent to follow natural language...

0 Yujie Lu, et al. ∙

research

∙ 09/04/2022

An Empirical Study of End-to-End Video-Language Transformers with Masked Visual Modeling

Masked visual modeling (MVM) has been recently proven effective for visu...

8 Tsu-Jui Fu, et al. ∙

research

∙ 06/06/2022

Neuro-Symbolic Causal Language Planning with Commonsense Prompting

Language planning aims to implement complex high-level goals by decompos...

0 Yujie Lu, et al. ∙

research

∙ 05/19/2022

Towards Understanding Gender-Seniority Compound Bias in Natural Language Generation

Women are often perceived as junior to their male counterparts, even wit...

0 Samhita Honnavalli, et al. ∙

research

∙ 05/11/2022

KETOD: Knowledge-Enriched Task-Oriented Dialogue

Existing studies in dialogue system research mostly treat task-oriented ...

8 Zhiyu Chen, et al. ∙

research

∙ 04/28/2022

HybriDialogue: An Information-Seeking Dialogue Dataset Grounded on Tabular and Textual Data

A pressing challenge in current dialogue systems is to successfully conv...

0 Kai Nakamura, et al. ∙

research

∙ 04/18/2022

Imagination-Augmented Natural Language Understanding

Human brains integrate linguistic and perceptual information simultaneou...

4 Yujie Lu, et al. ∙

research

∙ 04/18/2022

End-to-end Dense Video Captioning as Sequence Generation

Dense video captioning aims to identify the events of interest in an inp...

3 Wanrong Zhu, et al. ∙

research

∙ 03/20/2022

Towards Large-Scale Interpretable Knowledge Graph Reasoning for Dialogue Systems

Users interacting with voice assistants today need to phrase their reque...

0 Yi-Lin Tuan, et al. ∙

research

∙ 12/16/2021

Automatically Identifying Semantic Bias in Crowdsourced Natural Language Inference Datasets

Natural language inference (NLI) is an important task for producing usef...

11 Michael Saxon, et al. ∙

research

∙ 12/02/2021

Relational Graph Learning for Grounded Video Description Generation

Grounded video description (GVD) encourages captioning models to attend ...

0 Wenqiao Zhang, et al. ∙

research

∙ 11/24/2021

VIOLET : End-to-End Video-Language Transformers with Masked Visual-token Modeling

A great challenge in video-language (VidL) modeling lies in the disconne...

19 Tsu-Jui Fu, et al. ∙

research

∙ 10/22/2021

MIC: Model-agnostic Integrated Cross-channel Recommenders

Semantically connecting users and items is a fundamental problem for the...

0 Yujie Lu, et al. ∙

research

∙ 10/15/2021

ContraQA: Question Answering under Contradicting Contexts

With a rise in false, inaccurate, and misleading information in propagan...

0 Liangming Pan, et al. ∙

William Yang Wang

Featured Co-authors