Large-Scale Answerer in Questioner's Mind for Visual Dialog Question Generation

02/22/2019
by   Sang-Woo Lee, et al.
0

Answerer in Questioner's Mind (AQM) is an information-theoretic framework that has been recently proposed for task-oriented dialog systems. AQM benefits from asking a question that would maximize the information gain when it is asked. However, due to its intrinsic nature of explicitly calculating the information gain, AQM has a limitation when the solution space is very large. To address this, we propose AQM+ that can deal with a large-scale problem and ask a question that is more coherent to the current context of the dialog. We evaluate our method on GuessWhich, a challenging task-oriented visual dialog problem, where the number of candidate classes is near 10K. Our experimental results and ablation studies show that AQM+ outperforms the state-of-the-art models by a remarkable margin with a reasonable approximation. In particular, the proposed AQM+ reduces more than 60 the comparative algorithms diminish the error by less than 6 results, we argue that AQM+ is a general task-oriented dialog algorithm that can be applied for non-yes-or-no responses.

READ FULL TEXT
research
02/12/2018

Answerer in Questioner's Mind for Goal-Oriented Visual Dialogue

Goal-oriented dialogue has been paid attention for its numerous applicat...
research
11/24/2019

Task-Oriented Dialog Systems that Consider Multiple Appropriate Responses under the Same Context

Conversations have an intrinsic one-to-many property, which means that m...
research
07/06/2022

A Challenge on Semi-Supervised and Reinforced Task-Oriented Dialog Systems

A challenge on Semi-Supervised and Reinforced Task-Oriented Dialog Syste...
research
07/24/2019

Learning Goal-Oriented Visual Dialog Agents: Imitating and Surpassing Analytic Experts

This paper tackles the problem of learning a questioner in the goal-orie...
research
04/11/2019

Reasoning Visual Dialogs with Structural and Partial Observations

We propose a novel model to address the task of Visual Dialog which exhi...
research
08/10/2018

Mind Your Language: Learning Visually Grounded Dialog in a Multi-Agent Setting

The task of visually grounded dialog involves learning goal-oriented coo...
research
09/15/2022

UBARv2: Towards Mitigating Exposure Bias in Task-Oriented Dialogs

This paper studies the exposure bias problem in task-oriented dialog sys...

Please sign up or login with your details

Forgot password? Click here to reset