Predicting metrical patterns in Spanish poetry with language models

11/18/2020

∙

In this paper, we compare automated metrical pattern identification systems available for Spanish against extensive experiments done by fine-tuning language models trained on the same task. Despite being initially conceived as a model suitable for semantic tasks, our results suggest that BERT-based models retain enough structural information to perform reasonably well for Spanish scansion.

READ FULL TEXT

Predicting metrical patterns in Spanish poetry with language models

Tutorials on Stance Detection using Pre-trained Language Models: Fine-tuning BERT and Prompting Large Language Models

Do Language Models Learn Position-Role Mappings?

Let the Models Respond: Interpreting Language Model Detoxification Through the Lens of Prompt Dependence

User-Controlled Knowledge Fusion in Large Language Models: Balancing Creativity and Hallucination

Teaching Autoregressive Language Models Complex Tasks By Demonstration

Provable Limitations of Acquiring Meaning from Ungrounded Form: What will Future Language Models Understand?

Overthinking the Truth: Understanding how Language Models Process False Demonstrations

Predicting metrical patterns in Spanish poetry with language models

Related Research

Tutorials on Stance Detection using Pre-trained Language Models: Fine-tuning BERT and Prompting Large Language Models

Do Language Models Learn Position-Role Mappings?

Let the Models Respond: Interpreting Language Model Detoxification Through the Lens of Prompt Dependence

User-Controlled Knowledge Fusion in Large Language Models: Balancing Creativity and Hallucination

Teaching Autoregressive Language Models Complex Tasks By Demonstration

Provable Limitations of Acquiring Meaning from Ungrounded Form: What will Future Language Models Understand?

Overthinking the Truth: Understanding how Language Models Process False Demonstrations