DeepAI AI Chat
Log In Sign Up

Negative Sampling Improves Hypernymy Extraction Based on Projection Learning

07/12/2017
by   Dmitry Ustalov, et al.
0

We present a new approach to extraction of hypernyms based on projection learning and word embeddings. In contrast to classification-based approaches, projection-based methods require no candidate hyponym-hypernym pairs. While it is natural to use both positive and negative training examples in supervised relation extraction, the impact of negative examples on hypernym prediction was not studied so far. In this paper, we show that explicit negative examples used for regularization of the model significantly improve performance compared to the state-of-the-art approach of Fu et al. (2014) on three datasets from different languages.

READ FULL TEXT

page 1

page 2

page 3

page 4

06/21/2019

Exploiting Entity BIO Tag Embeddings and Multi-task Learning for Relation Extraction with Imbalanced Data

In practical scenario, relation extraction needs to first identify entit...
06/10/2016

Bootstrapping Distantly Supervised IE using Joint Learning and Small Well-structured Corpora

We propose a framework to improve performance of distantly-supervised re...
03/31/2021

Deep Neural Approaches to Relation Triplets Extraction: A Comprehensive Survey

Recently, with the advances made in continuous representation of words (...
11/28/2019

Improving Neural Relation Extraction with Positive and Unlabeled Learning

We present a novel approach to improve the performance of distant superv...
09/10/2018

Addressing the Fundamental Tension of PCGML with Discriminative Learning

Procedural content generation via machine learning (PCGML) is typically ...
01/14/2021

Structured Prediction as Translation between Augmented Natural Languages

We propose a new framework, Translation between Augmented Natural Langua...
12/12/2018

Adversarial Learning of Semantic Relevance in Text to Image Synthesis

We describe a new approach that improves the training of generative adve...