research
∙
02/01/2023
An Empirical Study on the Transferability of Transformer Modules in Parameter-Efficient Fine-Tuning
Parameter-efficient fine-tuning approaches have recently garnered a lot ...
share
research
∙
11/07/2022
Looking at the Overlooked: An Analysis on the Word-Overlap Bias in Natural Language Inference
It has been shown that NLI models are usually biased with respect to the...
research
∙
03/17/2022
On the Importance of Data Size in Probing Fine-tuned Models
Several studies have investigated the reasons behind the effectiveness o...
research
∙
10/09/2021
An Isotropy Analysis in the Multilingual BERT Embedding Space
Several studies have explored various advantages of multilingual pre-tra...
research
∙
09/10/2021
How Does Fine-tuning Affect the Geometry of Embedding Space: A Case Study on Isotropy
It is widely accepted that fine-tuning pre-trained language models usual...
research
∙
06/02/2021