Enhancing Sentence Relation Modeling with Auxiliary Character-level Embedding

03/30/2016
by   Peng Li, et al.
0

Neural network based approaches for sentence relation modeling automatically generate hidden matching features from raw sentence pairs. However, the quality of matching feature representation may not be satisfied due to complex semantic relations such as entailment or contradiction. To address this challenge, we propose a new deep neural network architecture that jointly leverage pre-trained word embedding and auxiliary character embedding to learn sentence meanings. The two kinds of word sequence representations as inputs into multi-layer bidirectional LSTM to learn enhanced sentence representation. After that, we construct matching features followed by another temporal CNN to learn high-level hidden matching feature representations. Experimental results demonstrate that our approach consistently outperforms the existing methods on standard evaluation datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/03/2019

Polyphone Disambiguation for Mandarin Chinese Using Conditional Neural Network with Multi-level Embedding Features

This paper describes a conditional neural network architecture for Manda...
research
05/21/2018

Sentence Modeling via Multiple Word Embeddings and Multi-level Comparison for Semantic Textual Similarity

Different word embedding models capture different aspects of linguistic ...
research
06/25/2017

A Deep Neural Architecture for Sentence-level Sentiment Classification in Twitter Social Networking

This paper introduces a novel deep learning framework including a lexico...
research
04/23/2016

Word2VisualVec: Image and Video to Sentence Matching by Visual Feature Prediction

This paper strives to find the sentence best describing the content of a...
research
07/23/2017

A Sequential Model for Classifying Temporal Relations between Intra-Sentence Events

We present a sequential model for temporal relation classification betwe...
research
12/06/2017

Learning Semantic Concepts and Order for Image and Sentence Matching

Image and sentence matching has made great progress recently, but it rem...
research
05/22/2020

SentPWNet: A Unified Sentence Pair Weighting Network for Task-specific Sentence Embedding

Pair-based metric learning has been widely adopted to learn sentence emb...

Please sign up or login with your details

Forgot password? Click here to reset