Harvesting Event Schemas from Large Language Models

05/12/2023
by   Jialong Tang, et al.
0

Event schema provides a conceptual, structural and formal language to represent events and model the world event knowledge. Unfortunately, it is challenging to automatically induce high-quality and high-coverage event schemas due to the open nature of real-world events, the diversity of event expressions, and the sparsity of event knowledge. In this paper, we propose a new paradigm for event schema induction – knowledge harvesting from large-scale pre-trained language models, which can effectively resolve the above challenges by discovering, conceptualizing and structuralizing event schemas from PLMs. And an Event Schema Harvester (ESHer) is designed to automatically induce high-quality event schemas via in-context generation-based conceptualization, confidence-aware schema structuralization and graph-based schema aggregation. Empirical results show that ESHer can induce high-quality and high-coverage event schemas on varying domains.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/05/2023

Open-Domain Hierarchical Event Schema Induction by Incremental Prompting and Verification

Event schemas are a form of world knowledge about the typical progressio...
research
05/22/2023

CEO: Corpus-based Open-Domain Event Ontology Induction

Existing event-centric NLP models often only apply to the pre-defined on...
research
04/16/2022

Probing Script Knowledge from Pre-Trained Models

Script knowledge is critical for humans to understand the broad daily ta...
research
04/12/2022

Mining Logical Event Schemas From Pre-Trained Language Models

We present NESL (the Neuro-Episodic Schema Learner), an event schema lea...
research
10/12/2022

Zero-Shot On-the-Fly Event Schema Induction

What are the events involved in a pandemic outbreak? What steps should b...
research
04/02/2021

An Empirical Characterization of Event Sourced Systems and Their Schema Evolution – Lessons from Industry

Event sourced systems are increasing in popularity because they are reli...
research
05/27/2023

A Diffusion Model for Event Skeleton Generation

Event skeleton generation, aiming to induce an event schema skeleton gra...

Please sign up or login with your details

Forgot password? Click here to reset