Volume 39 Issue 1
Jan.  2021
Turn off MathJax
Article Contents
HU Rui. An Implementation of Pseudo Corpus Generation for Chinese Spelling Checking[J]. DIGITAL TECHNOLOGY & APPLICATION, 2021, 39(1): 177-179. doi: 10.19695/j.cnki.cn12-1369.2021.01.55
Citation: HU Rui. An Implementation of Pseudo Corpus Generation for Chinese Spelling Checking[J]. DIGITAL TECHNOLOGY & APPLICATION, 2021, 39(1): 177-179. doi: 10.19695/j.cnki.cn12-1369.2021.01.55

An Implementation of Pseudo Corpus Generation for Chinese Spelling Checking

doi: 10.19695/j.cnki.cn12-1369.2021.01.55
  • Received Date: 2020-12-01
  • Rev Recd Date: 2021-01-17
  • Available Online: 2021-09-23
  • Publish Date: 2021-01-25
  • Most of Chinese spelling check tasks are implemented as sequence tagging tasks. However, those implementations are limited by the size and source of corpus they used. By now, most of Chinese spelling check corpus are extracted from a condition called CFL (Chinese as Foreign Language), which the errors are made by Chinese language learners when they are writing in an exam. Corpus constructed by this method are often limited by cost, which further limited their size. Those limitations make them hardly be used in spelling check task for publish industry. This paper composes a method to generate large amount of pseudo corpus from Wikipedia.

     

  • loading
  • China:Association for Computational Linguistics,2015:32-37.
    [2]
    CHOE Y J,HAM J,PARK K.A Neural Grammatical Error Correction System Built on Better Pre-training and Sequential Transfer Learning[C].ACL 2019 BEA Workshop Shared Task,2019:32-43.
    [3]
    VASWANI A,SHAZEER N,PARMAR N.Attention Is All You Need[J]. Computer Science,Mathematics,2017(5):1-12.
    [4]
    HONG Y,YU X,HE N.Faspel:a fast,adaptable,simple, powerful Chinese spell checker based on dae-decoder paradigm[C].Proceedings of the 5th Workshop on Noisy User-generated Text (W-NUT 2019).Hong Kong,China:Association for Computational Linguistics,2019:160-169.
  • 加载中

Catalog

    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Article Metrics

    Article views (82) PDF downloads(3) Cited by()
    Proportional views
    Related
    Copyright © Editorial Department of Digital Technology and Application Supported by: Beijing Renhe Information Technology Co. Ltd

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return