What's to know? Uncertainty as a Guide to Asking Goal-oriented Questions

12/16/2018
by   Ehsan Abbasnejad, et al.
0

One of the core challenges in Visual Dialogue problems is asking the question that will provide the most useful information towards achieving the required objective. Encouraging an agent to ask the right questions is difficult because we don't know a-priori what information the agent will need to achieve its task, and we don't have an explicit model of what it knows already. We propose a solution to this problem based on a Bayesian model of the uncertainty in the implicit model maintained by the visual dialogue agent, and in the function used to select an appropriate output. By selecting the question that minimises the predicted regret with respect to this implicit model the agent actively reduces ambiguity. The Bayesian model of uncertainty also enables a principled method for identifying when enough information has been acquired, and an action should be selected. We evaluate our approach on two goal-oriented dialogue datasets, one for visual-based collaboration task and the other for a negotiation-based task. Our uncertainty-aware information-seeking model outperforms its counterparts in these two challenging problems.

READ FULL TEXT

page 3

page 7

page 12

research
06/29/2021

Unified Questioner Transformer for Descriptive Question Generation in Goal-Oriented Visual Dialogue

Building an interactive artificial intelligence that can ask questions a...
research
12/16/2018

An Active Information Seeking Model for Goal-oriented Vision-and-Language Tasks

As Computer Vision algorithms move from passive analysis of pixels to ac...
research
05/23/2023

Towards Asking Clarification Questions for Information Seeking on Task-Oriented Dialogues

Task-oriented dialogue systems aim at providing users with task-specific...
research
02/12/2018

Answerer in Questioner's Mind for Goal-Oriented Visual Dialogue

Goal-oriented dialogue has been paid attention for its numerous applicat...
research
10/19/2021

Open-domain clarification question generation without question examples

An overarching goal of natural language processing is to enable machines...
research
09/11/2021

Looking for Confirmations: An Effective and Human-Like Visual Dialogue Strategy

Generating goal-oriented questions in Visual Dialogue tasks is a challen...
research
10/12/2021

Decision-Theoretic Question Generation for Situated Reference Resolution: An Empirical Study and Computational Model

Dialogue agents that interact with humans in situated environments need ...

Please sign up or login with your details

Forgot password? Click here to reset