AILAB-Udine@SMM4H 22: Limits of Transformers and BERT Ensembles

09/07/2022

∙

This paper describes the models developed by the AILAB-Udine team for the SMM4H 22 Shared Task. We explored the limits of Transformer based models on text classification, entity extraction and entity normalization, tackling Tasks 1, 2, 5, 6 and 10. The main take-aways we got from participating in different tasks are: the overwhelming positive effects of combining different architectures when using ensemble learning, and the great potential of generative models for term normalization.

READ FULL TEXT

AILAB-Udine@SMM4H 22: Limits of Transformers and BERT Ensembles

BERT-based Ranking for Biomedical Entity Normalization

UPB at IberLEF-2023 AuTexTification: Detection of Machine-Generated Text using Transformer Ensembles

Transformer-based Models of Text Normalization for Speech Applications

Discriminative and Generative Transformer-based Models For Situation Entity Classification

Stanford MLab at SemEval-2023 Task 10: Exploring GloVe- and Transformer-Based Methods for the Explainable Detection of Online Sexism

Fancy Man Lauches Zippo at WNUT 2020 Shared Task-1: A Bert Case Model for Wet Lab Entity Extraction

IITK at SemEval-2020 Task 10: Transformers for Emphasis Selection

AILAB-Udine@SMM4H 22: Limits of Transformers and BERT Ensembles

Related Research

BERT-based Ranking for Biomedical Entity Normalization

UPB at IberLEF-2023 AuTexTification: Detection of Machine-Generated Text using Transformer Ensembles

Transformer-based Models of Text Normalization for Speech Applications

Discriminative and Generative Transformer-based Models For Situation Entity Classification

Stanford MLab at SemEval-2023 Task 10: Exploring GloVe- and Transformer-Based Methods for the Explainable Detection of Online Sexism

Fancy Man Lauches Zippo at WNUT 2020 Shared Task-1: A Bert Case Model for Wet Lab Entity Extraction

IITK at SemEval-2020 Task 10: Transformers for Emphasis Selection