Exploiting Contextual Information with Deep Neural Networks

06/21/2020
by   Ismail Elezi, et al.
0

Context matters! Nevertheless, there has not been much research in exploiting contextual information in deep neural networks. For most part, the entire usage of contextual information has been limited to recurrent neural networks. Attention models and capsule networks are two recent ways of introducing contextual information in non-recurrent models, however both of these algorithms have been developed after this work has started. In this thesis, we show that contextual information can be exploited in 2 fundamentally different ways: implicitly and explicitly. In the DeepScore project, where the usage of context is very important for the recognition of many tiny objects, we show that by carefully crafting convolutional architectures, we can achieve state-of-the-art results, while also being able to implicitly correctly distinguish between objects which are virtually identical, but have different meanings based on their surrounding. In parallel, we show that by explicitly designing algorithms (motivated from graph theory and game theory) that take into considerations the entire structure of the dataset, we can achieve state-of-the-art results in different topics like semi-supervised learning and similarity learning. To the best of our knowledge, we are the first to integrate graph-theoretical modules, carefully crafted for the problem of similarity learning and that are designed to consider contextual information, not only outperforming the other models, but also gaining a speed improvement while using a smaller number of parameters.

READ FULL TEXT
research
06/06/2019

Contextual Relabelling of Detected Objects

Contextual information, such as the co-occurrence of objects and the spa...
research
10/19/2020

Global Attention for Name Tagging

Many name tagging approaches use local contextual information with much ...
research
12/02/2020

Smarter Password Guessing Techniques Leveraging Contextual Information and OSINT

In recent decades, criminals have increasingly used the web to research,...
research
11/29/2021

Learning Context-Aware Embedding for Person Search

Person Search is a relevant task that aims to jointly solve Person Detec...
research
10/25/2022

Orchestrating Networked Robotic Applications

In this letter, we formulate the orchestration problem for networked rob...
research
11/23/2020

Sarcasm detection from user-generated noisy short text

Sentiment analysis of social media comments is very important for review...
research
04/12/2022

Open-set Text Recognition via Character-Context Decoupling

The open-set text recognition task is an emerging challenge that require...

Please sign up or login with your details

Forgot password? Click here to reset