Automatic Generation of Socratic Subquestions for Teaching Math Word Problems

11/23/2022
by   Kumar Shridhar, et al.
0

Socratic questioning is an educational method that allows students to discover answers to complex problems by asking them a series of thoughtful questions. Generation of didactically sound questions is challenging, requiring understanding of the reasoning process involved in the problem. We hypothesize that such questioning strategy can not only enhance the human performance, but also assist the math word problem (MWP) solvers. In this work, we explore the ability of large language models (LMs) in generating sequential questions for guiding math word problem-solving. We propose various guided question generation schemes based on input conditioning and reinforcement learning. On both automatic and human quality evaluations, we find that LMs constrained with desirable question properties generate superior questions and improve the overall performance of a math word problem solver. We conduct a preliminary user study to examine the potential value of such question generation models in the education domain. Results suggest that the difficulty level of problems plays an important role in determining whether questioning improves or hinders human performance. We discuss the future of using such questioning strategies in education.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/13/2023

How Useful are Educational Questions Generated by Large Language Models?

Controllable text generation (CTG) by large language models has a huge p...
research
05/13/2023

Scalable Educational Question Generation with Pre-trained Language Models

The automatic generation of educational questions will play a key role i...
research
09/15/2023

Using Large Language Model to Solve and Explain Physics Word Problems Approaching Human Level

Our work demonstrates that large language model (LLM) pre-trained on tex...
research
09/21/2022

Seeking Diverse Reasoning Logic: Controlled Equation Expression Generation for Solving Math Word Problems

To solve Math Word Problems, human students leverage diverse reasoning l...
research
09/27/2021

Automatic Generation of Word Problems for Academic Education via Natural Language Processing (NLP)

Digital learning platforms enable students to learn on a flexible and in...
research
01/01/2023

Chatbots as Problem Solvers: Playing Twenty Questions with Role Reversals

New chat AI applications like ChatGPT offer an advanced understanding of...
research
05/23/2023

MathDial: A Dialogue Tutoring Dataset with Rich Pedagogical Properties Grounded in Math Reasoning Problems

Although automatic dialogue tutors hold great potential in making educat...

Please sign up or login with your details

Forgot password? Click here to reset