Optimization of Information-Seeking Dialogue Strategy for Argumentation-Based Dialogue System

by   Hisao Katsumi, et al.

Argumentation-based dialogue systems, which can handle and exchange arguments through dialogue, have been widely researched. It is required that these systems have sufficient supporting information to argue their claims rationally; however, the systems often do not have enough of such information in realistic situations. One way to fill in the gap is acquiring such missing information from dialogue partners (information-seeking dialogue). Existing information-seeking dialogue systems are based on handcrafted dialogue strategies that exhaustively examine missing information. However, the proposed strategies are not specialized in collecting information for constructing rational arguments. Moreover, the number of system's inquiry candidates grows in accordance with the size of the argument set that the system deal with. In this paper, we formalize the process of information-seeking dialogue as Markov decision processes (MDPs) and apply deep reinforcement learning (DRL) for automatically optimizing a dialogue strategy. By utilizing DRL, our dialogue strategy can successfully minimize objective functions, the number of turns it takes for our system to collect necessary information in a dialogue. We conducted dialogue experiments using two datasets from different domains of argumentative dialogue. Experimental results show that the proposed formalization based on MDP works well, and the policy optimized by DRL outperformed existing heuristic dialogue strategies.


page 1

page 2

page 3

page 4


Deep Reinforcement Learning for Multi-Domain Dialogue Systems

Standard deep reinforcement learning methods such as Deep Q-Networks (DQ...

Interrogating the Black Box: Transparency through Information-Seeking Dialogues

This paper is preoccupied with the following question: given a (possibly...

Deep Reinforcement Learning for On-line Dialogue State Tracking

Dialogue state tracking (DST) is a crucial module in dialogue management...

An Argumentative Dialogue System for COVID-19 Vaccine Information

Dialogue systems are widely used in AI to support timely and interactive...

Machine Learning for Utility Prediction in Argument-Based Computational Persuasion

Automated persuasion systems (APS) aim to persuade a user to believe som...

Strategic Dialogue Management via Deep Reinforcement Learning

Artificially intelligent agents equipped with strategic skills that can ...

A Dialogue Concerning Two World Systems: Info-Computational vs. Mechanistic

The dialogue develops arguments for and against adopting a new world sys...

Please sign up or login with your details

Forgot password? Click here to reset