基于增强特征融合网络的安全帽佩戴检测

doi:10.16180/j.cnki.issn1007-7820.2023.04.006

Abstract

Abstract:

Wearing safety helmet is one of the important ways to ensure the safety of workers in production activities. The detection accuracy and speed of the existing helmet detector need to be improved, which makes it difficult for the existing detectors to be applied in real production activities on a large scale. To solve these problems, the helmet detector based on EfficientDet is introduced and improved from the perspective of feature fusion. Specifically, the model reduces the information loss in the process of feature fusion using feature supplement module, and improves the efficiency of feature fusion using improved feature pyramid and adaptive spatial fusion module, and finally achieves the goal of improving performance. Experimental results show that the accuracy of the improved model on the helmet wearing data set is 83.03%, and the model size does not increase significantly. The accuracy of the model on PASCAL VOC 2007 data set is 82.76%.

Key words: helmet wearing detection, feature fusion, feature pyramid, object detection, EfficientDet, spatial fusion, deep learning, convolutional neural network

CLC Number:

TP391

CUI Zhuodong,CHEN Wei,YIN Zhong. Helmet Wearing Detection Based on Enhanced Feature Fusion Network[J].Electronic Science and Technology, 2023, 36(4): 44-51.

Figures/Tables 16

Figure 1.

Figure 2.

Figure 3.

Figure 4.

Figure 5.

Figure 6.

Figure 7.

Figure 8.

Figure 9.

Figure 10.

Figure 11.

Table 1.

Figure 12.

Table 2.

Table 3.

Figure 13.

References 22

[1]	Du S, Shehata M, Badawy W. Hard hat detection in video sequences based on face features, motion and color information[C]. Shanghai: Proceedings of the Third International Conference on Computer Research and Development, 2011.
[2]	Fang Q, Li H, Luo X C. Detection non-hardhat-use by a deep learning method from far field surveillance videos[J]. Automation in Construction, 2018, 85(1):1-9. doi: 10.1016/j.autcon.2017.09.018
[3]	Ren S Q, He K M, Girshick R, et al. Faster R-CNN:To-wards real-time object detection with region proposal networks[J]. Advances in Neural Information Processing Systems, 2015, 28(2):91-99.
[4]	方明, 孙腾腾, 邵桢. 基于改进YOLOv2的快速安全帽佩戴检测情况检测[J]. 光学精密工程, 2019, 27(5):1196-1205. doi: 10.3788/OPE.
	Fang Ming, Sun Tengteng, Shao Zhen. Fast helmet-wearing condition detection based on improved YOLOv2[J]. Optics and Precision Engineering, 2019, 27(5):1196-1205. doi: 10.3788/OPE.
[5]	Redmon J, Farhadi A. YOLO9000:Better,faster,stronger[C]. Honolulu: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017.
[6]	Howard A G, Zhu M L, Chen B, et al. MobileNets:Efficient convolutional neural networks for mobile vision applications[C]. Honolulu: Proceedings of the International Conference on Computer Vision and Pattern Recognition, 2017.
[7]	徐守坤, 王雅如, 顾玉宛, 等. 基于改进Faster RCNN的安全帽佩戴检测研究[J]. 计算机应用研究, 2020, 37(3):901-905.
	Xu Shoukun, Wang Yaru, Gu Yuwan, et al. Safety helmet wearing detection study based on improved Faster RCNN[J]. Application Research of Computers, 2020, 37(3):901-905.
[8]	仝泽友, 冯仕民, 侯晓晴, 等. 基于安全帽佩戴检测的矿山人员违规行为研究[J]. 电子科技, 2019, 32(9):26-31.
	Tong Zeyou, Feng Shimin, Hou Xiaoqing, et al. Recognition of underground miners’ rule-violated behavior based on safety helmet detection[J]. Electronic Science and Technology[J]. 2019, 32(9):26-31.
[9]	Krizhevsky A, Sutskever I, Hinton G E. ImageNet classification with deep convolutional neural networks[J]. Advances in Neural Information Processing Systems, 2012, 25(12):1097-1105.
[10]	Simonyan K, Zisserman A. Very deep convolutional networks for largescale image recognition[C]. Banff: Proceedings of the International Conference on Learning Representations, 2014.
[11]	Liu W, Anguelov D, Erhan D, et al. SSD:Single shot multibox detector[C]. Amsterdam: Proceedings of the European Conference on Computer Vision, 2016.
[12]	Lin T Y, Dollár P, Girshick R, et al. Feature pyramid networks for object detection[C]. Washington,D.C.:Proce-edings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017.
[13]	Lin T Y, Goyal P, Girshick R, et al. Focal loss for dense object detection[C]. Venice: Proceedings of the IEEE International Conference on Computer Vision, 2017.
[14]	Bochkovskly A, Wang C Y, Liao H Y M. YOLOv4:Optimal speed and accuracy of object detection[C]. Seattle: Proceedings of the International Conference on Computer Vision and Pattern Recognition, 2020.
[15]	Tan M, Pang R, Le Q V. EfficientDet:Scalable and effi-cient object detection[C]. Washington,D.C.:Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020.
[16]	Liu S, Qi L, Qin H, et al. Path aggregation network for instance segmentation[C]. Washington,D.C.:Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018.
[17]	Guo C X, Fan B, Zhang Q, et al. AugFPN:Impeoving multi-scale feature learning for object detection[C]. Seattle: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020.
[18]	Liu S T, Huang D, Wang Y H. Learning spatial fusion for single-shot object detection[J]. Computing Research Repository, 2019,1-10.
[19]	王平, 江雨泽, 赵光辉. 目标检测的多尺度定位提升算法[J]. 西安电子科技大学学报, 2021, 48(3):85-90.
	Wang Ping, Jiang Yuze, Zhao Guanghui. Object detectionbased on the multiscale location enhancement network[J]. Journal of Xidian University, 2021, 48(3):85-90.
[20]	袁帅, 王康, 单义, 等. 基于多分支并行空洞卷积的多尺度目标检测算法[J]. 计算机辅助设计与图形学学报, 2021, 33(6):864-872.
	Yuan Shuai, Wang Kang, Shan Yi, et al. Multi-scale obj-ect detection method based on multi-branch parallel dilated convolution[J]. Journal of Computer-Aided Design & Computer Graphics, 2021, 33(6):864-872.
[21]	Liu S T, Huang D. Receptive filed block net for accurate and fast object detection[C]. Munich: Proceedings of the European Conference on Computer Vision, 2018.
[22]	刘晋, 邓洪敏, 徐泽林, 等. 面向目标识别的轻量化混合卷积神经网络[J]. 计算机应用, 2021, 41(10):1-8
	Liu Jin, Deng Hongmin, Xu Zelin, et al. Lightweight hybrid convolutional neural network for object recognition[J]. Journal of Computer Applications, 2021, 41(10):1-8.

模型	特征补充	改进 BiFPN	ASF	AP/%	FPS	权重文件大小/MB
SSD				78.20	20.6	100.3
YOLOv3				80.40	29.1	235.0
Faster-RCNN(VGG)				77.10	3.5	522.0
Faster-RCNN(ResNet)				78.30	7.2	108.0
CenterNet				81.80	18.1	125.0
RetinaNet				82.40	21.8	140.0
EfficientDet				81.19	25.3	15.0
EfficientDet	√			82.08	25.2	15.1
EfficientDet	√	√		82.32	25.0	15.8
EfficientDet	√	√	√	83.03	22.4	16.3

模型	主干网络	AP/%	FPS	权重文件大小/MB
RefineDet^[19]	VGG	81.80	34.1	78.1
YOLOv3^[19]	DarkNet	82.20	19.6	236.0
Faster-RCNN^[20]	ResNet	76.40	2.4	109.0
SDD^[20]	VGG	78.60	26.6	101.0
RFB512^[21]	VGG	82.20	38.0	190.0
改进的YOLOv4^[22]	MobileNet	82.50	29.7	20.6
EfficientDet	EfficientNet	81.61	26.9	15.0
Ours	EfficientNet	82.76	24.2	16.3

类别	AP/%
Horse	98
Sheep	96
TV monitor	96
Train	95
Motorbike	95
Cat	94
Car	92
Aeroplane	91
Bicycle	91
Bus	88
Person	87
Dog	86
Cow	84
Bird	76
Bottle	72
Sofa	70
Chair	62
Boat	61
Potted plant	61
Dining table	59

Helmet Wearing Detection Based on Enhanced Feature Fusion Network

RichHTML

PDF (PC)

Like

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 16

References 22

Related Articles 15

Metrics

Comments

Recommended 0

[1]	WANG Ziyi, CHEN Shiping. Self-Supervised Network Intrusion Detection Model Based on Graph Contrastive Learning [J]. Electronic Science and Technology, 2025, 38(3): 22-31.
[2]	ZHAO Yunfei, XUE Cunjin. A Remote Sensing Image Water Extraction Method by Combining Atrous Convolution and Pooling Models [J]. Electronic Science and Technology, 2025, 38(3): 40-46.
[3]	CHEN Yuyang, LI Feng. Integration of CNN and Transformer for Retinal OCT Image Fluid Segmentation Method [J]. Electronic Science and Technology, 2025, 38(3): 47-59.
[4]	ZHENG Fangliang, WANG Yannian, LIAN Jihong, RUAN Pei. Face Image Super-Resolution Reconstruction Based on Conditional Priori Swin Transformer [J]. Electronic Science and Technology, 2025, 38(2): 35-41.
[5]	MA Zhuang, GAN Kaiyu, YIN Zhong. Emotion Recognition Based on Multimodal Fusion of the EEG and Peripheral Physiological Signals [J]. Electronic Science and Technology, 2025, 38(2): 62-69.
[6]	LAI Ying, JU Zhiyong, YE Yuxin. A Vehicle Detection Algorithm Based on Improved YOLOv4 [J]. Electronic Science and Technology, 2025, 38(1): 81-87.
[7]	HE Zhiqiang, SUN Zhanquan. Swin-Transformer-Based Carotid Ultrasound Image Plaque Segmentation [J]. Electronic Science and Technology, 2024, 37(9): 48-56.
[8]	ZHU Yong, HUANG Yongming, HE Xing. Research on Object Detection Based on Radar and Video Fusion [J]. Electronic Science and Technology, 2024, 37(8): 1-7.
[9]	XIE Xijun, LI Feifei. Non-Local Support Attention Network for Few-Shot Object Detection [J]. Electronic Science and Technology, 2024, 37(8): 75-83.
[10]	HE Xing, HUANG Yongming, ZHU Yong. Pavement Pothole Detection Method Based on Improved YOLOv5 [J]. Electronic Science and Technology, 2024, 37(7): 53-59.
[11]	ZHAO Xu, HU Demin. Multi-Path Parallel Multi-Scale Feature Reuse for Remote Sensing Image Super-Resolution [J]. Electronic Science and Technology, 2024, 37(6): 61-68.
[12]	YE Yuxin, JU Zhiyong, LAI Ying. Traffic Sign Detection Algorithm Incorporating Receptive Field Enhancement Module and Attention Mechanism [J]. Electronic Science and Technology, 2024, 37(6): 8-16.
[13]	YUAN Ao, QI Jinpeng, JIA Can, XUE Yuxin, GUO Yangyang. A Classification Method of Time Series Pathological Data Segments Based on Deep Learning [J]. Electronic Science and Technology, 2024, 37(6): 84-91.
[14]	ZHU Zihao, SONG Yan. Lightweight Capsule Network Fusing Attention and Capsule Pooling [J]. Electronic Science and Technology, 2024, 37(5): 1-8.
[15]	XIA Rongcheng, LIU Deer. Vehicle Detection and Analysis in Urban Waterlogging Area Based on Deep Learning [J]. Electronic Science and Technology, 2024, 37(5): 18-24.