首页 / 资料库 / 文献详情

ALICE:A Pre-trained Language Representation Model for Chinese Technological Text Analysis

WANG Yingjie, XIE Bin, LI Ningbo

2020DOAJ (DOAJ: Directory of Open Access Journals)Computer Science被引 1

摘要

The deep model of natural language processing rely on huge,high-quality and human-annotated dataset.In order to alleviate such dependency,this paper proposes a BERT-based natural language processing pre-trained model for Chinese technological text named ALICE.Improve Masked Language Model(MLM) and combine it with entity-level mask to boost the base model’s performance on downstream tasks,and let the learned representations fit Chinese trait much better.Experimental results show that,compared with the BERT model,ALICE model improves the classification accuracy of Chinese technological texts and the F1 value of named entity recognition by 1.2% and 0.8%,respectively.

引用本文（GB/T 7714）

DOI：https://doi.org/10.19678/j.issn.1000-3428.0055246