DeepAI AI Chat
Log In Sign Up

AmbigQA: Answering Ambiguous Open-domain Questions

by   Sewon Min, et al.
University of Washington

Ambiguity is inherent to open-domain question answering; especially when exploring new topics, it can be difficult to ask questions that have a single, unambiguous answer. In this paper, we introduce AmbigQA, a new open-domain question answering task which involves predicting a set of question-answer pairs, where every plausible answer is paired with a disambiguated rewrite of the original question. To study this task, we construct AmbigNQ, a dataset covering 14,042 questions from NQ-open, an existing open-domain QA benchmark. We find that over half of the questions in NQ-open are ambiguous, exhibiting diverse types of ambiguity. We also present strong baseline models for AmbigQA which we show benefit from weakly supervised learning that incorporates NQ-open, strongly suggesting our new task and data will support significant future research effort. Our data is available at


page 1

page 2

page 3

page 4


CREPE: Open-Domain Question Answering with False Presuppositions

Information seeking users often pose questions with false presupposition...

ManyModalQA: Modality Disambiguation and QA over Diverse Inputs

We present a new multimodal question answering challenge, ManyModalQA, i...

Answering Ambiguous Questions through Generative Evidence Fusion and Round-Trip Prediction

In open-domain question answering, questions are highly likely to be amb...

Learning to Answer Ambiguous Questions with Knowledge Graph

In the task of factoid question answering over knowledge base, many ques...

Unsupervised Question Clarity Prediction Through Retrieved Item Coherency

Despite recent progress on conversational systems, they still do not per...

Selectively Answering Ambiguous Questions

Trustworthy language models should abstain from answering questions when...

QUADRo: Dataset and Models for QUestion-Answer Database Retrieval

An effective paradigm for building Automated Question Answering systems ...

Code Repositories


AmbigQA: Answering Ambiguous Open-domain Questions

view repo