Investigating Glyph Phonetic Information for Chinese Spell Checking: What Works and What's Next

12/08/2022
by   Xiaotian Zhang, et al.
0

While pre-trained Chinese language models have demonstrated impressive performance on a wide range of NLP tasks, the Chinese Spell Checking (CSC) task remains a challenge. Previous research has explored using information such as glyphs and phonetics to improve the ability to distinguish misspelled characters, with good results. However, the generalization ability of these models is not well understood: it is unclear whether they incorporate glyph-phonetic information and, if so, whether this information is fully utilized. In this paper, we aim to better understand the role of glyph-phonetic information in the CSC task and suggest directions for improvement. Additionally, we propose a new, more challenging, and practical setting for testing the generalizability of CSC models. All code is made publicly available.

READ FULL TEXT
research
02/21/2022

StyleBERT: Chinese pretraining by font style information

With the success of down streaming task using English pre-trained langua...
research
01/29/2019

Glyce: Glyph-vectors for Chinese Character Representations

It is intuitive that NLP tasks for logographic languages like Chinese sh...
research
05/05/2023

Block the Label and Noise: An N-Gram Masked Speller for Chinese Spell Checking

Recently, Chinese Spell Checking(CSC), a task to detect erroneous charac...
research
06/30/2021

ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Information

Recent pretraining models in Chinese neglect two important aspects speci...
research
05/24/2023

Self-Checker: Plug-and-Play Modules for Fact-Checking with Large Language Models

Fact-checking is an essential task in NLP that is commonly utilized for ...
research
09/10/2021

Investigating Numeracy Learning Ability of a Text-to-Text Transfer Model

The transformer-based pre-trained language models have been tremendously...
research
06/20/2023

FAIR: A Causal Framework for Accurately Inferring Judgments Reversals

Artificial intelligence researchers have made significant advances in le...

Please sign up or login with your details

Forgot password? Click here to reset