Adapting Event Extractors to Medical Data: Bridging the Covariate Shift

08/21/2020
by   Aakanksha Naik, et al.
0

We tackle the task of adapting event extractors to new domains without labeled data, by aligning the marginal distributions of source and target domains. As a testbed, we create two new event extraction datasets using English texts from two medical domains: (i) clinical notes, and (ii) doctor-patient conversations. We test the efficacy of three marginal alignment techniques: (i) adversarial domain adaptation (ADA), (ii) domain adaptive fine-tuning (DAFT), and (iii) a novel instance weighting technique based on language model likelihood scores (LIW). LIW and DAFT improve over a no-transfer BERT baseline on both domains, but ADA only improves on clinical notes. Deeper analysis of performance under different types of shifts (e.g., lexical shift, semantic shift) reveals interesting variations among models. Our best-performing models reach F1 scores of 70.0 and 72.9 on notes and conversations respectively, using no labeled data from target domains.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/22/2020

Towards Open Domain Event Trigger Identification using Adversarial Domain Adaptation

We tackle the task of building supervised event trigger identification m...
research
10/23/2019

Generalized Domain Adaptation with Covariate and Label Shift CO-ALignment

Unsupervised knowledge transfer has a great potential to improve the gen...
research
09/20/2022

Generalizing through Forgetting – Domain Generalization for Symptom Event Extraction in Clinical Notes

Symptom information is primarily documented in free-text clinical notes ...
research
02/21/2017

Just DIAL: DomaIn Alignment Layers for Unsupervised Domain Adaptation

The empirical fact that classifiers, trained on given data collections, ...
research
05/03/2023

Clinical Note Generation from Doctor-Patient Conversations using Large Language Models: Insights from MEDIQA-Chat

This paper describes our submission to the MEDIQA-Chat 2023 shared task ...
research
10/14/2022

Mention Annotations Alone Enable Efficient Domain Adaptation for Coreference Resolution

Although, recent advances in neural network models for coreference resol...
research
02/10/2023

Federated Domain Adaptation via Gradient Projection

Federated Domain Adaptation (FDA) describes the federated learning setti...

Please sign up or login with your details

Forgot password? Click here to reset