Word-Emoji Embeddings from large scale Messaging Data reflect real-world Semantic Associations of Expressive Icons

05/19/2020
by   Jens Helge Reelfs, et al.
0

We train word-emoji embeddings on large scale messaging data obtained from the Jodel online social network. Our data set contains more than 40 million sentences, of which 11 million sentences are annotated with a subset of the Unicode 13.0 standard Emoji list. We explore semantic emoji associations contained in this embedding by analyzing associations between emojis, between emojis and text, and between text and emojis. Our investigations demonstrate anecdotally that word-emoji embeddings trained on large scale messaging data can reflect real-world semantic associations. To enable further research we release the Jodel Emoji Embedding Dataset (JEED1488) containing 1488 emojis and their embeddings along 300 dimensions.

READ FULL TEXT
research
11/24/2016

Training and Evaluating Multimodal Word Embeddings with Large-scale Web Annotated Images

In this paper, we focus on training and evaluating effective word embedd...
research
03/25/2018

The Geometry of Culture: Analyzing Meaning through Word Embeddings

We demonstrate the utility of a new methodological tool, neural-network ...
research
12/14/2020

Model Choices Influence Attributive Word Associations: A Semi-supervised Analysis of Static Word Embeddings

Static word embeddings encode word associations, extensively utilized in...
research
06/06/2020

ValNorm: A New Word Embedding Intrinsic Evaluation Method Reveals Valence Biases are Consistent Across Languages and Over Decades

Word embeddings learn implicit biases from linguistic regularities captu...
research
03/14/2018

LSH Microbatches for Stochastic Gradients: Value in Rearrangement

Metric embeddings are immensely useful representation of interacting ent...
research
04/27/2015

On a Possible Similarity between Gene and Semantic Networks

In several domains such as linguistics, molecular biology or social scie...
research
05/25/2022

Semantic Embeddings in Semilattices

To represent anything from mathematical concepts to real-world objects, ...

Please sign up or login with your details

Forgot password? Click here to reset