DAG-based Long Short-Term Memory for Neural Word Segmentation

07/02/2017
by   Xinchi Chen, et al.
0

Neural word segmentation has attracted more and more research interests for its ability to alleviate the effort of feature engineering and utilize the external resource by the pre-trained character or word embeddings. In this paper, we propose a new neural model to incorporate the word-level information for Chinese word segmentation. Unlike the previous word-based models, our model still adopts the framework of character-based sequence labeling, which has advantages on both effectiveness and efficiency at the inference stage. To utilize the word-level information, we also propose a new long short-term memory (LSTM) architecture over directed acyclic graph (DAG). Experimental results demonstrate that our model leads to better performances than the baseline models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/23/2017

Long Short-Term Memory for Japanese Word Segmentation

This study presents a Long Short-Term Memory (LSTM) neural network appro...
research
06/14/2016

Neural Word Segmentation Learning for Chinese

Most previous approaches to Chinese word segmentation formalize this pro...
research
12/23/2017

Dual Long Short-Term Memory Networks for Sub-Character Representation Learning

Characters have commonly been regarded as the minimal processing unit in...
research
04/27/2023

Analyzing Vietnamese Legal Questions Using Deep Neural Networks with Biaffine Classifiers

In this paper, we propose using deep neural networks to extract importan...
research
04/15/2023

TransDocs: Optical Character Recognition with word to word translation

While OCR has been used in various applications, its output is not alway...
research
12/30/2020

A Subword Guided Neural Word Segmentation Model for Sindhi

Deep neural networks employ multiple processing layers for learning text...
research
05/30/2017

Generating Steganographic Text with LSTMs

Motivated by concerns for user privacy, we design a steganographic syste...

Please sign up or login with your details

Forgot password? Click here to reset