Towards Semi-Supervised Learning for Deep Semantic Role Labeling

08/28/2018
by   Sanket Vaibhav Mehta, et al.
0

Neural models have shown several state-of-the-art performances on Semantic Role Labeling (SRL). However, the neural models require an immense amount of semantic-role corpora and are thus not well suited for low-resource languages or domains. The paper proposes a semi-supervised semantic role labeling method that outperforms the state-of-the-art in limited SRL training corpora. The method is based on explicitly enforcing syntactic constraints by augmenting the training objective with a syntactic-inconsistency loss component and uses SRL-unlabeled instances to train a joint-objective LSTM. On CoNLL-2012 English section, the proposed semi-supervised training with 1 and varying amounts of SRL-unlabeled data achieves +1.58, +0.78 F1, respectively, over the pre-trained models that were trained on SOTA architecture with ELMo on the same SRL-labeled data. Additionally, by using the syntactic-inconsistency loss on inference time, the proposed model achieves +3.67, +2.1 F1 over pre-trained model on 1 respectively.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/13/2018

When Semi-Supervised Learning Meets Transfer Learning: Training Strategies, Models and Datasets

Semi-Supervised Learning (SSL) has been proved to be an effective way to...
research
05/01/2020

Structured Tuning for Semantic Role Labeling

Recent neural network-driven semantic role labeling (SRL) systems have s...
research
10/19/2021

Neural Medication Extraction: A Comparison of Recent Models in Supervised and Semi-supervised Learning Settings

Drug prescriptions are essential information that must be encoded in ele...
research
08/11/2020

S2OSC: A Holistic Semi-Supervised Approach for Open Set Classification

Open set classification (OSC) tackles the problem of determining whether...
research
05/27/2020

Self-Training for Unsupervised Parsing with PRPN

Neural unsupervised parsing (UP) models learn to parse without access to...
research
11/29/2020

Improved Semantic Role Labeling using Parameterized Neighborhood Memory Adaptation

Deep neural models achieve some of the best results for semantic role la...
research
05/21/2022

Masterful: A Training Platform for Computer Vision Models

Masterful is a software platform to train deep learning computer vision ...

Please sign up or login with your details

Forgot password? Click here to reset