AMRs Assemble! Learning to Ensemble with Autoregressive Models for AMR Parsing

In this paper, we examine the current state-of-the-art in AMR parsing, which relies on ensemble strategies by merging multiple graph predictions. Our analysis reveals that the present models often violate AMR structural constraints. To address this issue, we develop a validation method, and show how ensemble models can exploit SMATCH metric weaknesses to obtain higher scores, but sometimes result in corrupted graphs. Additionally, we highlight the demanding need to compute the SMATCH score among all possible predictions. To overcome these challenges, we propose two novel ensemble strategies based on Transformer models, improving robustness to structural constraints, while also reducing the computational time. Our methods provide new insights for enhancing AMR parsers and metrics. Our code is available at \href{https://www.github.com/babelscape/AMRs-Assemble}{github.com/babelscape/AMRs-Assemble}.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/23/2023

Incorporating Graph Information in Transformer-based AMR Parsing

Abstract Meaning Representation (AMR) is a Semantic Parsing formalism th...
research
05/25/2022

Rethinking Fano's Inequality in Ensemble Learning

We propose a fundamental theory on ensemble learning that evaluates a gi...
research
05/24/2023

Are Pre-trained Language Models Useful for Model Ensemble in Chinese Grammatical Error Correction?

Model ensemble has been in widespread use for Grammatical Error Correcti...
research
04/11/2021

Non-Autoregressive Semantic Parsing for Compositional Task-Oriented Dialog

Semantic parsing using sequence-to-sequence models allows parsing of dee...
research
05/19/2022

CLCNet: Rethinking of Ensemble Modeling with Classification Confidence Network

In this paper, we propose a Classification Confidence Network (CLCNet) t...
research
12/11/2020

A Comparative Analysis of the Ensemble Methods for Drug Design

Quantitative structure-activity relationship (QSAR) is a computer modeli...
research
09/29/2022

A Two-Stage Method for Chinese AMR Parsing

In this paper, we provide a detailed description of our system at CAMRP-...

Please sign up or login with your details

Forgot password? Click here to reset