Electronic Science and Technology ›› 2024, Vol. 37 ›› Issue (2): 87-95.doi: 10.16180/j.cnki.issn1007-7820.2024.02.012

Previous Articles    

Classification Method of Steel Surface Defects Based on Multi-Scale Feature Fusion

TIAN Zhixin1,XU Zhen1,MAO Jian1,LIN Binbin1,LIAO Wei2   

  1. 1. School of Mechanical and Automotive Engineering,Shanghai University of Engineering Science, Shanghai 201620,China
    2. School of Electronic and Electrical Engineering,Shanghai University of Engineering Science,Shanghai 201620,China
  • Received:2022-10-14 Online:2024-02-15 Published:2024-01-18
  • Supported by:
    National Natural Science Foundation of China(62001282)


In view of the low detection rate of steel surface defect classification, a surface defect classification method based on texture multi-scale feature fusion is adopted. Gabor filter and gray level co-occurrence matrix are used to establish multi-scale feature vectors of texture images. At the same time, convolution operation is used to extract features of texture images, and hybrid dilated convolution module is introduced to increase receptive field. The two feature vectors are fused to obtain the enhanced fused texture feature vector. The fused features are input into Long Short-Term Memory(LSTM) network in sequence to build a classification model, and the classification results are evaluated using the confusion matrix. The results show that the classification accuracy of this method on the NEU(Northeastern University) data set is 97.5%. The LSTM network, BP(Back Propagation) neural network, SVM(Support Vector Machine), KNN(K-Nearest Neighbor), CART(Classification And Regression Tree) and other classification methods are set up for comparative experiments. The results show that LSTM classification method performs best in multi-scale, and F1 index is the highest. Ablation experiments are conducted with BP network, LSTM network, SVM, KNN, CART, CNN, AlexNet and other methods to verify the universality of this method. This method fully exploits the multi-scale feature information of the texture image, and has important significance for the research of the classification method of steel surface defects.

Key words: urface defect classification, multi-scale feature fusion, Gabor filter, gray level co-occurrence matrix, mixed expansion convolution, convolution operation, LSTM network, confusion matrix, NEU data set

CLC Number: 

  • TP391