From Examples to Rules: Neural Guided Rule Synthesis for Information Extraction

01/16/2022
by   Robert Vacareanu, et al.
0

While deep learning approaches to information extraction have had many successes, they can be difficult to augment or maintain as needs shift. Rule-based methods, on the other hand, can be more easily modified. However, crafting rules requires expertise in linguistics and the domain of interest, making it infeasible for most users. Here we attempt to combine the advantages of these two directions while mitigating their drawbacks. We adapt recent advances from the adjacent field of program synthesis to information extraction, synthesizing rules from provided examples. We use a transformer-based architecture to guide an enumerative search, and show that this reduces the number of steps that need to be explored before a rule is found. Further, we show that without training the synthesis algorithm on the specific domain, our synthesized rules achieve state-of-the-art performance on the 1-shot scenario of a task that focuses on few-shot learning for relation classification, and competitive performance in the 5-shot scenario.

READ FULL TEXT
research
03/12/2020

Learning Compositional Rules via Neural Program Synthesis

Many aspects of human reasoning, including language, require learning ru...
research
04/19/2022

Example-based Synthesis of Static Analysis Rules

Static Analysis tools have rules for several code quality issues and the...
research
06/16/2021

Domain-independent User Simulation with Transformers for Task-oriented Dialogue Systems

Dialogue policy optimisation via reinforcement learning requires a large...
research
07/18/2022

PBRE: A Rule Extraction Method from Trained Neural Networks Designed for Smart Home Services

Designing smart home services is a complex task when multiple services w...
research
06/13/2016

Matching Networks for One Shot Learning

Learning from a few examples remains a key challenge in machine learning...
research
05/12/2021

Ensemble Making Few-Shot Learning Stronger

Few-shot learning has been proposed and rapidly emerging as a viable mea...
research
08/23/2021

Rewrite Rule Inference Using Equality Saturation

Many compilers, synthesizers, and theorem provers rely on rewrite rules ...

Please sign up or login with your details

Forgot password? Click here to reset