Fast Neural Chinese Word Segmentation for Long Sentences

11/06/2018
by   Sufeng Duan, et al.
0

Rapidly developed neural models have achieved competitive performance in Chinese word segmentation (CWS) as their traditional counterparts. However, most of methods encounter the computational inefficiency especially for long sentences because of the increasing model complexity and slower decoders. This paper presents a simple neural segmenter which directly labels the gap existence between adjacent characters to alleviate the existing drawback. Our segmenter is fully end-to-end and capable of performing segmentation very fast. We also show a performance difference with different tag sets. The experiments show that our segmenter can provide comparable performance with state-of-the-art.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/24/2017

Fast and Accurate Neural Word Segmentation for Chinese

Neural models with minimal feature engineering have achieved competitive...
research
04/21/2016

Evaluation of the Effect of Improper Segmentation on Word Spotting

Word spotting is an important recognition task in historical document an...
research
11/03/2022

Joint Chinese Word Segmentation and Span-based Constituency Parsing

In constituency parsing, span-based decoding is an important direction. ...
research
06/14/2016

Neural Word Segmentation Learning for Chinese

Most previous approaches to Chinese word segmentation formalize this pro...
research
10/07/2018

Unsupervised Neural Word Segmentation for Chinese via Segmental Language Modeling

Previous traditional approaches to unsupervised Chinese word segmentatio...
research
05/21/2019

A realistic and robust model for Chinese word segmentation

A realistic Chinese word segmentation tool must adapt to textual variati...
research
08/29/2018

Neural Metaphor Detection in Context

We present end-to-end neural models for detecting metaphorical word use ...

Please sign up or login with your details

Forgot password? Click here to reset