Hinrich Schütze

research

∙ 12/19/2022

Cross-Lingual Retrieval Augmented Prompt for Low-Resource Languages

Multilingual Pretrained Language Models (MPLMs) have shown their strong ...

Ercong Nie, et al. ∙

research

∙ 12/18/2022

PVGRU: Generating Diverse and Relevant Dialogue Responses via Pseudo-Variational Mechanism

We investigate response generation for multi-turn dialogue in generative...

Yongkang Liu, et al. ∙

research

∙ 12/14/2022

Unsupervised Detection of Contextualized Embedding Bias with Application to Ideology

We propose a fully unsupervised method to detect bias in contextualized ...

Valentin Hofmann, et al. ∙

research

∙ 11/15/2022

MEAL: Stable and Active Learning for Few-Shot Prompting

Few-shot classification in NLP has recently made great strides due to th...

Abdullatif Köksal, et al. ∙

research

∙ 10/25/2022

This joke is [MASK]: Recognizing Humor and Offense with Prompting

Humor is a magnetic component in everyday human interactions and communi...

Junze Li, et al. ∙

research

∙ 10/24/2022

The Better Your Syntax, the Better Your Semantics? Probing Pretrained Language Models for the English Comparative Correlative

Construction Grammar (CxG) is a paradigm from cognitive linguistics emph...

Leonie Weissweiler, et al. ∙

research

∙ 10/18/2022

Graph-Based Multilingual Label Propagation for Low-Resource Part-of-Speech Tagging

Part-of-Speech (POS) tagging is an important component of the NLP pipeli...

Ayyoob Imani, et al. ∙

research

∙ 10/12/2022

SilverAlign: MT-Based Silver Data Algorithm For Evaluating Word Alignment

Word alignments are essential for a variety of NLP tasks. Therefore, cho...

Abdullatif Köksal, et al. ∙

research

∙ 10/12/2022

Federated Continual Learning for Text Classification via Selective Inter-client Transfer

In this work, we combine the two paradigms: Federated Learning (FL) and ...

Yatin Chaudhary, et al. ∙

research

∙ 09/26/2022

Modeling Content-Emotion Duality via Disentanglement for Empathetic Conversation

The task of empathetic response generation aims to understand what feeli...

Peiqin Lin, et al. ∙

research

∙ 07/28/2022

Measuring Causal Effects of Data Statistics on Language Model's `Factual' Predictions

Large amounts of training data are one of the major reasons for the high...

Yanai Elazar, et al. ∙

research

∙ 05/31/2022

Don't Forget Cheap Training Signals Before Building Unsupervised Bilingual Word Embeddings

Bilingual Word Embeddings (BWEs) are one of the cornerstones of cross-li...

Silvia Severini, et al. ∙

research

∙ 05/13/2022

Analyzing Hate Speech Data along Racial, Gender and Intersectional Axes

To tackle the rising phenomenon of hate speech, efforts have been made t...

Antonis Maronikolakis, et al. ∙

research

∙ 04/26/2022

Flow-Adapter Architecture for Unsupervised Machine Translation

In this work, we propose a flow-adapter architecture for unsupervised NM...

Yihong Liu, et al. ∙

research

∙ 03/31/2022

Domain Adaptation for Sparse-Data Settings: What Do We Gain by Not Using Bert?

The practical success of much of NLP depends on the availability of trai...

Marina Sedinkina, et al. ∙

research

∙ 03/18/2022

CaMEL: Case Marker Extraction without Labels

We introduce CaMEL (Case Marker Extraction without Labels), a novel and ...

Leonie Weissweiler, et al. ∙

research

∙ 03/17/2022

Enhanced Temporal Knowledge Embeddings with Contextualized Language Representations

With the emerging research effort to integrate structured and unstructur...

Zhen Han, et al. ∙

research

∙ 03/16/2022

Graph Neural Networks for Multiparallel Word Alignment

After a period of decrease, interest in word alignments is increasing ag...

Ayyoob Imani, et al. ∙

research

∙ 03/16/2022

Geographic Adaptation of Pretrained Language Models

Geographic linguistic features are commonly used to improve the performa...

Valentin Hofmann, et al. ∙

research

∙ 03/15/2022

Modular and Parameter-Efficient Multimodal Fusion with Prompting

Recent research has made impressive progress in large-scale multimodal p...

Sheng Liang, et al. ∙

research

∙ 03/11/2022

CoDA21: Evaluating Language Understanding Capabilities of NLP Models With Context-Definition Alignment

Pretrained language models (PLMs) have achieved superhuman performance o...

Lutfi Kerem Senel, et al. ∙

research

∙ 02/12/2022

Semantic-Oriented Unlabeled Priming for Large-Scale Language Models

Due to the high costs associated with finetuning large language models, ...

Yanchen Liu, et al. ∙

research

∙ 01/28/2022

Towards a Broad Coverage Named Entity Resource: A Data-Efficient Approach for Many Diverse Languages

Parallel corpora are ideal for extracting a multilingual named entity (M...

Silvia Severini, et al. ∙

research

∙ 11/26/2021

True Few-Shot Learning with Prompts – A Real-World Perspective

Prompt-based approaches are strong at few-shot learning. However, Perez ...

Timo Schick, et al. ∙

research

∙ 09/29/2021

BeliefBank: Adding Memory to a Pre-Trained Language Model for a Systematic Notion of Belief

Although pretrained language models (PTLMs) contain significant amounts ...

Nora Kassner, et al. ∙

research

∙ 09/28/2021

Active Learning for Argument Mining: A Practical Approach

Despite considerable recent progress, the creation of well-balanced and ...

Nikolai Solmsdorf, et al. ∙

research

∙ 09/23/2021

Scene Graph Generation for Better Image Captioning?

We investigate the incorporation of visual relationships into the task o...

Maximilian Mozes, et al. ∙

research

∙ 09/20/2021

BERT Cannot Align Characters

In previous work, it has been shown that BERT can adequately align cross...

Antonis Maronikolakis, et al. ∙

research

∙ 09/16/2021

Locating Language-Specific Information in Contextualized Embeddings

Multilingual pretrained language models (MPLMs) exhibit multilinguality ...

Sheng Liang, et al. ∙

research

∙ 09/13/2021

Graph Algorithms for Multiparallel Word Alignment

With the advent of end-to-end deep learning approaches in machine transl...

Ayyoob Imani, et al. ∙

research

∙ 09/13/2021

Wine is Not v i n. – On the Compatibility of Tokenizations Across Languages

The size of the vocabulary is a central design choice in large pretraine...

Antonis Maronikolakis, et al. ∙

research

∙ 09/08/2021

Continuous Entailment Patterns for Lexical Inference in Context

Combining a pretrained language model (PLM) with textual patterns has be...

Martin Schmitt, et al. ∙

research

∙ 09/08/2021

Discrete and Soft Prompting for Multilingual Models

It has been shown for English that discrete and soft prompting perform s...

Mengjie Zhao, et al. ∙

research

∙ 09/05/2021

Semi-Automated Labeling of Requirement Datasets for Relation Extraction

Creating datasets manually by human annotators is a laborious task that ...

Jeremias Bohn, et al. ∙

research

∙ 07/14/2021

ParCourE: A Parallel Corpus Explorer for a Massively Multilingual Corpus

With more than 7000 languages worldwide, multilingual natural language p...

Ayyoob Imani, et al. ∙

research

∙ 07/02/2021

Data Centric Domain Adaptation for Historical Text with OCR Errors

We propose new methods for in-domain and cross-domain Named Entity Recog...

Luisa März, et al. ∙

research

∙ 04/18/2021

Modeling Ideological Agenda Setting and Framing in Polarized Online Groups with Graph Neural Networks and Structured Sparsity

The increasing polarization of online political discourse calls for comp...

Valentin Hofmann, et al. ∙

research

∙ 04/17/2021

Multi-source Neural Topic Modeling in Multi-view Embedding Spaces

Though word embeddings and topics are complementary representations, sev...

Pankaj Gupta, et al. ∙

research

∙ 04/16/2021

Enriching a Model's Notion of Belief using a Persistent Memory

Although pretrained language models (PTLMs) have been shown to contain s...

Nora Kassner, et al. ∙

research

∙ 04/15/2021

Generating Datasets with Pretrained Language Models

To obtain high-quality sentence embeddings from pretrained language mode...

Timo Schick, et al. ∙

research

∙ 04/14/2021

Static Embeddings as Efficient Knowledge Bases?

Recent research investigates factual knowledge stored in large pretraine...

Philipp Dufter, et al. ∙

research

∙ 02/28/2021

Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLP

When trained on large, unfiltered crawls from the internet, language mod...

Timo Schick, et al. ∙

research

∙ 02/22/2021

Position Information in Transformers: An Overview

Transformers are arguably the main workhorse in recent Natural Language ...

Philipp Dufter, et al. ∙

research

∙ 02/10/2021

Language Models for Lexical Inference in Context

Lexical inference in context (LIiC) is the task of recognizing textual e...

Martin Schmitt, et al. ∙

research

∙ 02/09/2021

Improving Visual Reasoning by Exploiting The Knowledge in Texts

This paper presents a new framework for training image-based classifiers...

Sahand Sharifzadeh, et al. ∙

research

∙ 02/06/2021

Does He Wink or Does He Nod? A Challenging Benchmark for Evaluating Word Understanding of Language Models

Recent progress in pretraining language models on large corpora has resu...

Lutfi Kerem Senel, et al. ∙

research

∙ 02/01/2021

Multilingual LAMA: Investigating Knowledge in Multilingual Pretrained Language Models

Recently, it has been found that monolingual English language models can...

Nora Kassner, et al. ∙

research

∙ 01/02/2021

Superbizarre Is Not Superb: Improving BERT's Interpretations of Complex Words with Derivational Morphology

How does the input segmentation of pretrained language models (PLMs) aff...

Valentin Hofmann, et al. ∙

research

∙ 12/31/2020

A Closer Look at Few-Shot Crosslingual Transfer: Variance, Benchmarks and Baselines

We present a focused study of few-shot crosslingual transfer, a recently...

Mengjie Zhao, et al. ∙

research

∙ 12/22/2020

Few-Shot Text Generation with Pattern-Exploiting Training

Providing pretrained language models with simple task descriptions or pr...

Timo Schick, et al. ∙

Hinrich Schütze

Featured Co-authors