Frustratingly Simple Entity Tracking with Effective Use of Multi-Task Learning Models

10/12/2022
by   Janvijay Singh, et al.
6

We present SET, a frustratingly Simple-yet-effective approach for Entity Tracking in procedural text. Compared with state-of-the-art entity tracking models that require domain-specific pre-training, SET simply fine-tunes off-the-shelf T5 with customized formats and gets comparable or even better performance on multiple datasets. Concretely, SET tackles the state and location prediction in entity tracking independently and formulates them as multi-choice and extractive QA problems, respectively. Through a series of careful analyses, we show that T5's supervised multi-task learning plays an important role in the success of SET. In addition, we reveal that SET has a strong capability of understanding implicit entity transformations, suggesting that multi-task transfer learning should be further explored in future entity tracking research.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/01/2020

Analyzing the Effect of Multi-task Learning for Biomedical Named Entity Recognition

Developing high-performing systems for detecting biomedical named entiti...
research
01/11/2022

In Defense of the Unitary Scalarization for Deep Multi-Task Learning

Recent multi-task learning research argues against unitary scalarization...
research
09/27/2022

Design Perspectives of Multitask Deep Learning Models and Applications

In recent years, multi-task learning has turned out to be of great succe...
research
10/05/2018

Entity Tracking Improves Cloze-style Reading Comprehension

Reading comprehension tasks test the ability of models to process long-t...
research
07/20/2020

A Comprehensive Evaluation of Multi-task Learning and Multi-task Pre-training on EHR Time-series Data

Multi-task learning (MTL) is a machine learning technique aiming to impr...
research
11/21/2022

Enhancing Crisis-Related Tweet Classification with Entity-Masked Language Modeling and Multi-Task Learning

Social media has become an important information source for crisis manag...
research
11/20/2020

Cost-effective Variational Active Entity Resolution

Accurately identifying different representations of the same real-world ...

Please sign up or login with your details

Forgot password? Click here to reset