XLTime: A Cross-Lingual Knowledge Transfer Framework for Temporal Expression Extraction

05/03/2022
by   Yuwei Cao, et al.
3

Temporal Expression Extraction (TEE) is essential for understanding time in natural language. It has applications in Natural Language Processing (NLP) tasks such as question answering, information retrieval, and causal inference. To date, work in this area has mostly focused on English as there is a scarcity of labeled data for other languages. We propose XLTime, a novel framework for multilingual TEE. XLTime works on top of pre-trained language models and leverages multi-task learning to prompt cross-language knowledge transfer both from English and within the non-English languages. XLTime alleviates problems caused by a shortage of data in the target language. We apply XLTime with different language models and show that it outperforms the previous automatic SOTA methods on French, Spanish, Portuguese, and Basque, by large margins. XLTime also closes the gap considerably on the handcrafted HeidelTime method.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/16/2021

Language Models are Few-shot Multilingual Learners

General-purpose language models have demonstrated impressive capabilitie...
research
01/16/2023

XNLI 2.0: Improving XNLI dataset and performance on Cross Lingual Understanding (XLU)

Natural Language Processing systems are heavily dependent on the availab...
research
05/23/2023

RET-LLM: Towards a General Read-Write Memory for Large Language Models

Large language models (LLMs) have significantly advanced the field of na...
research
12/05/2014

Integer Programming Ensemble of Classifiers for Temporal Relations

Extraction of events and understanding related temporal expression among...
research
04/09/2021

TransWiC at SemEval-2021 Task 2: Transformer-based Multilingual and Cross-lingual Word-in-Context Disambiguation

Identifying whether a word carries the same meaning or different meaning...
research
03/31/2023

Dataset and Baseline System for Multi-lingual Extraction and Normalization of Temporal and Numerical Expressions

Temporal and numerical expression understanding is of great importance i...
research
08/28/2020

Knowledge Efficient Deep Learning for Natural Language Processing

Deep learning has become the workhorse for a wide range of natural langu...

Please sign up or login with your details

Forgot password? Click here to reset