Chinese named entity recognition using adversarial training and attention mechanism

Conference: CIBDA 2022 - 3rd International Conference on Computer Information and Big Data Applications
03/25/2022 - 03/27/2022 at Wuhan, China

Proceedings: CIBDA 2022

Pages: 5Language: englishTyp: PDF

Authors:
Yang, Puquan; Guo, Wenjing; Chang, Shan; Liu, Guohua; Huang, Qiubo; Wang, Bingyue (Department of Computer Science and Technology, Donghua University, Shanghai, China)
Lu, Ting (Department of Computer Science and Technology, Donghua University, Shanghai, China & Engineering Research Center of Digitalized Textile and Fashion Technology, Ministry of Education, Shanghai, China)

Abstract:
Chinese NER plays an important role in natural language processing as a fundamental task. The current character-based training approach for Chinese NER suffers from the inability to incorporate overall sentence features or character neighbourhood features into the character vector. In this paper, we designed a feature enhancement module with attention mechanism and BI-LSTM networks to enhance the feature extraction capability of the model and proposed the introduction of adversarial training as a method of enhancing data to improve the robustness of the model. It has been proven through extensive experiments that the accuracy of the model in Chinese NER task has been improved after the introduction of the adversarial training and feature enhancement modules. In our experiments, we choose the BERT-CRF network as our baseline model.