Take a Break in the Middle: Investigating Subgoals towards Hierarchical Script Generation

05/18/2023
by   Xinze Li, et al.
0

Goal-oriented Script Generation is a new task of generating a list of steps that can fulfill the given goal. In this paper, we propose to extend the task from the perspective of cognitive theory. Instead of a simple flat structure, the steps are typically organized hierarchically - Human often decompose a complex task into subgoals, where each subgoal can be further decomposed into steps. To establish the benchmark, we contribute a new dataset, propose several baseline methods, and set up evaluation metrics. Both automatic and human evaluation verify the high-quality of dataset, as well as the effectiveness of incorporating subgoals into hierarchical script generation. Furthermore, We also design and evaluate the model to discover subgoal, and find that it is a bit more difficult to decompose the goals than summarizing from segmented steps.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/07/2023

Hierarchical Catalogue Generation for Literature Review: A Benchmark

Multi-document scientific summarization can extract and organize importa...
research
09/19/2019

Goal-Embedded Dual Hierarchical Model for Task-Oriented Dialogue Generation

Hierarchical neural networks are often used to model inherent structures...
research
05/19/2016

A Hierarchical Latent Variable Encoder-Decoder Model for Generating Dialogues

Sequential data often possesses a hierarchical structure with complex de...
research
12/15/2022

ROSCOE: A Suite of Metrics for Scoring Step-by-Step Reasoning

Large language models show improved downstream task performance when pro...
research
06/13/2023

HAUSER: Towards Holistic and Automatic Evaluation of Simile Generation

Similes play an imperative role in creative writing such as story and di...
research
08/29/2023

TaskLAMA: Probing the Complex Task Understanding of Language Models

Structured Complex Task Decomposition (SCTD) is the problem of breaking ...
research
08/25/2022

Multimedia Generative Script Learning for Task Planning

Goal-oriented generative script learning aims to generate subsequent ste...

Please sign up or login with your details

Forgot password? Click here to reset