b'Yoav Goldberg'

research

∙ 07/28/2022

Measuring Causal Effects of Data Statistics on Language Model's `Factual' Predictions

Large amounts of training data are one of the major reasons for the high...

Yanai Elazar, et al. ∙

research

∙ 06/26/2022

Rivendell: Project-Based Academic Search Engine

Finding relevant research literature in online databases is a familiar c...

Teddy Lazebnik, et al. ∙

research

∙ 05/25/2022

LingMess: Linguistically Informed Multi Expert Scorers for Coreference Resolution

While coreference resolution typically involves various linguistic chall...

Shon Otmazgin, et al. ∙

research

∙ 05/04/2022

A Dataset for N-ary Relation Extraction of Drug Combinations

Combination therapies have become the standard of care for diseases such...

Aryeh Tiktinsky, et al. ∙

research

∙ 04/26/2022

LM-Debugger: An Interactive Tool for Inspection and Intervention in Transformer-Based Language Models

The opaque nature and unexplained behavior of transformer-based language...

Mor Geva, et al. ∙

research

∙ 04/20/2022

Analyzing Gender Representation in Multilingual Models

Multilingual language models were shown to allow for nontrivial transfer...

Hila Gonen, et al. ∙

research

∙ 03/28/2022

Transformer Feed-Forward Layers Build Predictions by Promoting Concepts in the Vocabulary Space

Transformer-based language models (LMs) are at the core of modern NLP, b...

Mor Geva, et al. ∙

research

∙ 01/28/2022

Adversarial Concept Erasure in Kernel Space

The representation space of neural models for textual data emerges in an...

Shauli Ravfogel, et al. ∙

research

∙ 01/28/2022

Linear Adversarial Concept Erasure

Modern neural models trained on textual data rely on pre-trained represe...

Shauli Ravfogel, et al. ∙

research

∙ 01/27/2022

Human Interpretation of Saliency-based Explanation Over Text

While a lot of research in explainable AI focuses on producing effective...

Hendrik Schuff, et al. ∙

research

∙ 01/27/2022

Diagnosing AI Explanation Methods with Folk Concepts of Behavior

When explaining AI behavior to humans, how is the communicated informati...

Alon Jacovi, et al. ∙

research

∙ 12/28/2021

Simple, Interpretable and Stable Method for Detecting Words with Usage Change across Corpora

The problem of comparing two bodies of text and searching for words that...

Hila Gonen, et al. ∙

research

∙ 10/14/2021

Large Scale Substitution-based Word Sense Induction

We present a word-sense induction method based on pre-trained masked lan...

Matan Eyal, et al. ∙

research

∙ 09/24/2021

Text-based NP Enrichment

Understanding the relations between entities denoted by NPs in text is a...

Yanai Elazar, et al. ∙

research

∙ 09/10/2021

Asking It All: Generating Contextualized Questions for any Semantic Role

Asking questions about a situation is an inherent step towards understan...

Valentina Pyatkin, et al. ∙

research

∙ 06/30/2021

On the Power of Saturated Transformers: A View from Circuit Complexity

Transformers have become a standard architecture for many NLP problems. ...

William Merrill, et al. ∙

research

∙ 06/18/2021

BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models

We show that with small-to-medium training data, fine-tuning only the bi...

Elad Ben Zaken, et al. ∙

research

∙ 06/13/2021

Thinking Like Transformers

What is the computational model behind a Transformer? Where recurrent ne...

Gail Weiss, et al. ∙

research

∙ 06/08/2021

Neural Extractive Search

Domain experts often need to extract structured information from large c...

Shauli Ravfogel, et al. ∙

research

∙ 05/14/2021

Counterfactual Interventions Reveal the Causal Effect of Relative Clause Representations on Agreement Prediction

When language models process syntactically complex sentences, do they us...

Shauli Ravfogel, et al. ∙

research

∙ 04/22/2021

Provable Limitations of Acquiring Meaning from Ungrounded Form: What will Future Language Models Understand?

Language models trained on billions of tokens have recently led to unpre...

William Merrill, et al. ∙

research

∙ 04/17/2021

Revisiting Few-shot Relation Classification: Evaluation Data and Classification Schemes

We explore Few-Shot Learning (FSL) for Relation Classification (RC). Foc...

Ofer Sabo, et al. ∙

research

∙ 04/16/2021

Back to Square One: Bias Detection, Training and Commonsense Disentanglement in the Winograd Schema

The Winograd Schema (WS) has been proposed as a test for measuring commo...

Yanai Elazar, et al. ∙

research

∙ 04/15/2021

Does BERT Pretrained on Clinical Notes Reveal Sensitive Data?

Large Transformers pretrained over clinical notes from Electronic Health...

Eric Lehman, et al. ∙

research

∙ 03/02/2021

Contrastive Explanations for Model Interpretability

Contrastive explanations clarify why an event occurred in contrast to an...

Alon Jacovi, et al. ∙

research

∙ 02/09/2021

Bootstrapping Relation Extractors using Syntactic Search by Examples

The advent of neural-networks in NLP brought with it substantial improve...

Matan Eyal, et al. ∙

research

∙ 01/18/2021

A simple geometric proof for the benefit of depth in ReLU networks

We present a simple proof for the benefit of depth in multi-layer feedfo...

Asaf Amrami, et al. ∙

research

∙ 12/08/2020

Facts2Story: Controlling Text Generation by Key Facts

Recent advancements in self-attention neural network architectures have ...

Eyal Orbach, et al. ∙

research

∙ 10/19/2020

Parameter Norm Growth During Training of Transformers

The capacity of neural networks like the widely adopted transformer is k...

William Merrill, et al. ∙

research

∙ 10/16/2020

It's not Greek to mBERT: Inducing Word-Level Translations from Multilingual BERT

Recent works have demonstrated that multilingual BERT (mBERT) learns ric...

Hila Gonen, et al. ∙

research

∙ 10/15/2020

Formalizing Trust in Artificial Intelligence: Prerequisites, Causes and Goals of Human Trust in AI

Trust is a central component of the interaction between people and AI, i...

Alon Jacovi, et al. ∙

research

∙ 10/12/2020

The Extraordinary Failure of Complement Coercion Crowdsourcing

Crowdsourcing has eased and scaled up the collection of linguistic annot...

Yanai Elazar, et al. ∙

research

∙ 10/11/2020

Unsupervised Distillation of Syntactic Information from Contextualized Word Representations

Contextualized word representations, such as ELMo and BERT, were shown t...

Shauli Ravfogel, et al. ∙

research

∙ 10/09/2020

Relation Extraction as Two-way Span-Prediction

The current supervised relation classification (RC) task uses a single e...

Amir DN Cohen, et al. ∙

research

∙ 10/07/2020

Exposing Shallow Heuristics of Relation Extraction Models with Challenge Data

The process of collecting and annotating training data may introduce dis...

Shachar Rosenman, et al. ∙

research

∙ 06/11/2020

Teaching Pre-Trained Models to Systematically Reason Over Implicit Knowledge

To what extent can a neural network systematically reason over symbolic ...

Alon Talmor, et al. ∙

research

∙ 06/07/2020

Interactive Extractive Search over Biomedical Corpora

We present a system that allows life-science researchers to search a lin...

Hillel Taub-Tabib, et al. ∙

research

∙ 06/04/2020

Syntactic Search by Example

We present a system that allows a user to search a large linguistically ...

Micah Shlain, et al. ∙

research

∙ 06/01/2020

Aligning Faithful Interpretations with their Social Attribution

We find that the requirement of model interpretations to be faithful is ...

Alon Jacovi, et al. ∙

research

∙ 06/01/2020

When Bert Forgets How To POS: Amnesic Probing of Linguistic Properties and MLM Predictions

A growing body of work makes use of probing in order to investigate the ...

Yanai Elazar, et al. ∙

research

∙ 05/07/2020

Nakdan: Professional Hebrew Diacritizer

We present a system for automatic diacritization of Hebrew text. The sys...

Avi Shmidman, et al. ∙

research

∙ 05/04/2020

pyBART: Evidence-based Syntactic Transformations for IE

Syntactic dependencies can be predicted with high accuracy, and are usef...

Aryeh Tiktinsky, et al. ∙

research

∙ 05/03/2020

A Two-Stage Masked LM Method for Term Set Expansion

We tackle the task of Term Set Expansion (TSE): given a small seed set o...

Guy Kushilevitz, et al. ∙

research

∙ 04/18/2020

A Formal Hierarchy of RNN Architectures

We develop a formal hierarchy of the expressive capacity of RNN architec...

William Merrill, et al. ∙

research

∙ 04/16/2020

Null It Out: Guarding Protected Attributes by Iterative Nullspace Projection

The ability to control for the kinds of information encoded in neural re...

Shauli Ravfogel, et al. ∙

research

∙ 04/07/2020

Towards Faithfully Interpretable NLP Systems: How should we define and evaluate faithfulness?

With the growing popularity of deep-learning based NLP models, comes a n...

Alon Jacovi, et al. ∙

research

∙ 04/05/2020

Unsupervised Domain Clusters in Pretrained Language Models

The notion of "in-domain data" in NLP is often over-simplistic and vague...

Roee Aharoni, et al. ∙

research

∙ 01/31/2020

Break It Down: A Question Understanding Benchmark

Understanding natural language questions entails the ability to break do...

Tomer Wolfson, et al. ∙

research

∙ 12/31/2019

oLMpics – On what Language Model Pre-training Captures

Recent success of pre-trained language models (LMs) has spurred widespre...

Alon Talmor, et al. ∙

research

∙ 10/30/2019

How does Grammatical Gender Affect Noun Representations in Gender-Marking Languages?

Many natural languages assign grammatical gender also to inanimate nouns...

Hila Gonen, et al. ∙

Yoav Goldberg

Featured Co-authors