AI Chat AI Image Generator AI Video Text to Speech

An Accurate Model for Predicting the (Graded) Effect of Context in Word Similarity Based on Bert

05/03/2020

∙

by Wei Bao, et al.

∙

∙

Natural Language Processing (NLP) has been widely used in the semantic analysis in recent years. Our paper mainly discusses a methodology to analyze the effect that context has on human perception of similar words, which is the third task of SemEval 2020. We apply several methods in calculating the distance between two embedding vector generated by Bidirectional Encoder Representation from Transformer (BERT). Our teamwillgowon the 1st place in Finnish language track ofsubtask1, the second place in English track of subtask1.

Wei Bao
15 publications
Hongshu Che
1 publication
Jiandong Zhang
6 publications

research

∙ 07/09/2019

UW-BHI at MEDIQA 2019: An Analysis of Representation Methods for Medical Natural Language Inference

Recent advances in distributed language modeling have led to large perfo...

0 William R. Kearns, et al. ∙

research

∙ 11/04/2021

A text autoencoder from transformer for fast encoding language representation

In recent years BERT shows apparent advantages and great potential in na...

0 Tan Huang, et al. ∙

research

∙ 10/10/2020

Information Extraction from Swedish Medical Prescriptions with Sig-Transformer Encoder

Relying on large pretrained language models such as Bidirectional Encode...

0 John Pougue Biyong, et al. ∙

research

∙ 10/06/2020

Exploring BERT's Sensitivity to Lexical Cues using Tests from Semantic Priming

Models trained to estimate word probabilities in context have become ubi...

0 Kanishka Misra, et al. ∙

research

∙ 12/30/2020

Deriving Contextualised Semantic Features from BERT (and Other Transformer Model) Embeddings

Models based on the transformer architecture, such as BERT, have marked ...

12 Jacob Turton, et al. ∙

research

∙ 05/15/2023

Estimating the Causal Effects of Natural Logic Features in Neural NLI Models

Rigorous evaluation of the causal effects of semantic features on langua...

3 Julia Rozanova, et al. ∙

research

∙ 03/13/2021

Embedding Calibration for Music Semantic Similarity using Auto-regressive Transformer

One of the advantages of using natural language processing (NLP) technol...

0 Xinran Zhang, et al. ∙