Chatbots as Problem Solvers: Playing Twenty Questions with Role Reversals

01/01/2023
by   David Noever, et al.
0

New chat AI applications like ChatGPT offer an advanced understanding of question context and memory across multi-step tasks, such that experiments can test its deductive reasoning. This paper proposes a multi-role and multi-step challenge, where ChatGPT plays the classic twenty-questions game but innovatively switches roles from the questioner to the answerer. The main empirical result establishes that this generation of chat applications can guess random object names in fewer than twenty questions (average, 12) and correctly guess 94 The research introduces four novel cases where the chatbot fields the questions, asks the questions, both question-answer roles, and finally tries to guess appropriate contextual emotions. One task that humans typically fail but trained chat applications complete involves playing bilingual games of twenty questions (English answers to Spanish questions). Future variations address direct problem-solving using a similar inquisitive format to arrive at novel outcomes deductively, such as patentable inventions or combination thinking. Featured applications of this dialogue format include complex protein designs, neuroscience metadata, and child development educational materials.

READ FULL TEXT

page 4

page 7

page 8

page 9

research
09/10/2021

Asking It All: Generating Contextualized Questions for any Semantic Role

Asking questions about a situation is an inherent step towards understan...
research
02/05/2021

Think you have Solved Direct-Answer Question Answering? Try ARC-DA, the Direct-Answer AI2 Reasoning Challenge

We present the ARC-DA dataset, a direct-answer ("open response", "freefo...
research
10/12/2022

EduQG: A Multi-format Multiple Choice Dataset for the Educational Domain

We introduce a high-quality dataset that contains 3,397 samples comprisi...
research
11/23/2022

Automatic Generation of Socratic Subquestions for Teaching Math Word Problems

Socratic questioning is an educational method that allows students to di...
research
05/02/2018

AI safety via debate

To make AI systems broadly useful for challenging real-world tasks, we n...
research
08/15/2023

DiagGPT: An LLM-based Chatbot with Automatic Topic Management for Task-Oriented Dialogue

Large Language Models (LLMs), such as ChatGPT, are becoming increasingly...
research
10/22/2020

AI-lead Court Debate Case Investigation

The multi-role judicial debate composed of the plaintiff, defendant, and...

Please sign up or login with your details

Forgot password? Click here to reset