Electronic Science and Technology ›› 2019, Vol. 32 ›› Issue (12): 32-36.doi: 10.16180/j.cnki.issn1007-7820.2019.12.007

Previous Articles     Next Articles

Natural Scene Text Recognition Algorithm Based on Attention-CTC

HE Wenjie,LIU Jingbiao,PAN Mian,LÜ Shuaishuai   

  1. School of Electronic and Information,Hangzhou Dianzi University,Hangzhou 310018,China
  • Received:2018-12-07 Online:2019-12-15 Published:2019-12-24
  • Supported by:
    National Natural Science Foundation of China(61871164);National Natural Science Foundation of China(61501155)


In order to solve the problems of the difficulty of character segmentation in text recognition and the recognition accuracy dependent on dictionary in natural scene, a text recognition algorithm with attention mechanism and connection time classification loss was proposed. The convolutional neural network and the bidirectional long-term memory network were used to extra the feature of the image. The Attention-CTC structure was used to decode the feature sequence, which effectively solved the problem of Attention decoding unconstrained. The algorithm avoided additional alignment preprocessing and subsequent syntax processing on the tag, which sped up the training convergence rate and significantly improved the text recognition rate. Experimental results showed that the algorithm was robust to texts with complex fonts and complex backgrounds.

Key words: text recognition, connection time classification, convolution neural network, recurrent neural network, multi-scale feature extraction, attention mechanism

CLC Number: 

  • TP391