Multimodal Entity Linking for Tweets

04/07/2021
by   Omar Adjali, et al.
0

In many information extraction applications, entity linking (EL) has emerged as a crucial task that allows leveraging information about named entities from a knowledge base. In this paper, we address the task of multimodal entity linking (MEL), an emerging research field in which textual and visual information is used to map an ambiguous mention to an entity in a knowledge base (KB). First, we propose a method for building a fully annotated Twitter dataset for MEL, where entities are defined in a Twitter KB. Then, we propose a model for jointly learning a representation of both mentions and entities from their textual and visual contexts. We demonstrate the effectiveness of the proposed model by evaluating it on the proposed dataset and highlight the importance of leveraging visual information when it is available.

READ FULL TEXT
research
05/21/2022

Named Entity Linking on Namesakes

We propose a simple and practical method of named entity linking (NEL), ...
research
05/24/2023

AMELI: Enhancing Multimodal Entity Linking with Fine-Grained Attributes

We propose attribute-aware multimodal entity linking, where the input is...
research
11/09/2022

Visual Named Entity Linking: A New Dataset and A Baseline

Visual Entity Linking (VEL) is a task to link regions of images with the...
research
07/26/2017

Implicit Entity Linking in Tweets

Over the years, Twitter has become one of the largest communication plat...
research
12/21/2021

Multimodal Entity Tagging with Multimodal Knowledge Base

To enhance research on multimodal knowledge base and multimodal informat...
research
08/05/2019

Unsupervised Context Retrieval for Long-tail Entities

Monitoring entities in media streams often relies on rich entity represe...
research
10/26/2015

How to merge three different methods for information filtering ?

Twitter is now a gold marketing tool for entities concerned with online ...

Please sign up or login with your details

Forgot password? Click here to reset