Learning to Understand Phrases by Embedding the Dictionary

04/02/2015
by   Felix Hill, et al.
0

Distributional models that learn rich semantic word representations are a success story of recent NLP research. However, developing models that learn useful representations of phrases and sentences has proved far harder. We propose using the definitions found in everyday dictionaries as a means of bridging this gap between lexical and phrasal semantics. Neural language embedding models can be effectively trained to map dictionary definitions (phrases) to (lexical) representations of the words defined by those definitions. We present two applications of these architectures: "reverse dictionaries" that return the name of a concept given a definition or description and general-knowledge crossword question answerers. On both tasks, neural language embedding models trained on definitions from a handful of freely-available lexical resources perform as well or better than existing commercial systems that rely on significant task-specific engineering. The results highlight the effectiveness of both neural embedding architectures and definition-based training for developing models that understand phrases and sentences.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/01/2016

Definition Modeling: Learning to define word embeddings in natural language

Distributed representations of words have been shown to capture lexical ...
research
11/01/2018

Learning to Describe Phrases with Local and Global Contexts

When reading a text, it is common to become stuck on unfamiliar words an...
research
06/03/2017

Task-specific Word Identification from Short Texts Using a Convolutional Neural Network

Task-specific word identification aims to choose the task-related words ...
research
03/07/2015

Identifying missing dictionary entries with frequency-conserving context models

In an effort to better understand meaning from natural language texts, w...
research
08/06/2023

3D-EX : A Unified Dataset of Definitions and Dictionary Examples

Definitions are a fundamental building block in lexicography, linguistic...
research
05/01/2021

PREDICT: Persian Reverse Dictionary

Finding the appropriate words to convey concepts (i.e., lexical access) ...
research
05/31/2020

A Unified Feature Representation for Lexical Connotations

Ideological attitudes and stance are often expressed through subtle mean...

Please sign up or login with your details

Forgot password? Click here to reset