1Cademy @ Causal News Corpus 2022: Enhance Causal Span Detection via Beam-Search-based Position Selector
share
In this paper, we present our approach and empirical observations for Cause-Effect Signal Span Detection – Subtask 2 of Shared task 3 <cit.> at CASE 2022. The shared task aims to extract the cause, effect, and signal spans from a given causal sentence. We model the task as a reading comprehension (RC) problem and apply a token-level RC-based span prediction paradigm to the task as the baseline. We explore different training objectives to fine-tune the model, as well as data augmentation (DA) tricks based on the language model (LM) for performance improvement. Additionally, we propose an efficient beam-search post-processing strategy to due with the drawbacks of span detection to obtain a further performance gain. Our approach achieves an average F_1 score of 54.15 and ranks 1^st in the CASE competition. Our code is available at <https://github.com/Gzhang-umich/1CademyTeamOfCASE>.
READ FULL TEXT