Electronic Science and Technology ›› 2023, Vol. 36 ›› Issue (11): 35-40.doi: 10.16180/j.cnki.issn1007-7820.2023.11.006

Previous Articles     Next Articles

Named Entity Recognition of Automobile Production Equipment Fault Domain Based on BERT

NI Ji,WANG Yujia,ZHAO Bo   

  1. School of Electronic and Electrical Engineering, Shanghai University of Engineering Science, Shanghai 201600, China
  • Received:2022-04-06 Online:2023-11-15 Published:2023-11-20
  • Supported by:
    Scientific and Technological Innovation 2030-Major Project of New Generation Artificial Intelligence(2020AAA0109300)

Abstract:

In the field of automobile production equipment fault, the entity category of Chinese named entity is complicated, and the traditional word vector can not solve the polysemy of one word. In view of these problems, this study proposes a named entity recognition model in the field of automobile production equipment fault based on BERT(Bidirectional Encoder Representations From Transformer). First, the semantic information and syntactic features are extracted by BERT pretraining model to generate dynamic word vectors. Then, the word vector is input into bidirectional long-short term memory for bidirectional encoding to obtain the semantic features of long sequences. Finally, the conditional random field is used for sequence decoding to learn the dependency relationship between labels and obtain the optimal label sequence. Experiments are carried out on the self-built real automobile production equipment fault data set, and the accuracy, recall rate and F1 value are 87.9 %, 89.6 % and 88.7 %, respectively.

Key words: equipment fault, natural language processing, sequence labeling, named entity recognition, pre-training model, LSTM, conditional random fields, deep learning

CLC Number: 

  • TP391