主管:中华人民共和国应急管理部
主办:应急管理部天津消防研究所
ISSN 1009-0029  CN 12-1311/TU

消防科学与技术 ›› 2023, Vol. 42 ›› Issue (2): 253-257.

• • 上一篇    下一篇

基于自注意力的隧道视频火灾识别技术研究

沈鸿翔1,倪双静2   

  1. (1.杭州市城建消防中心(杭州市城建信息中心),浙江 杭州 310000;2.浙江省机电设计研究院有限公司,浙江 杭州 310051)
  • 出版日期:2023-02-15 发布日期:2023-02-17
  • 作者简介:作者简介:沈鸿翔(1989- ),男,浙江杭州人,杭州市城建消防中心(杭州市城建信息中心),高级工程师,主要从事图像处理、大数据挖掘方面的研究,浙江省杭州市上城区解放东路18号,310000。

Research on fire recognition technology of tunnel video based on self-attention

Shen Hongxiang1, Ni Shuangjing2   

  1. (1. Hangzhou Urban Construction Fire Protection Center (Hangzhou Urban Construction Information Center), Zhejiang Hangzhou 310000, China; 2. Zhejiang Institute of Mechanical & Electrical Engineering, Zhejiang Hangzhou 310051, China)
  • Online:2023-02-15 Published:2023-02-17

摘要: 针对公路隧道火灾样本量少、深度学习效果不理想的问题,研究一种小样本学习技术,以提高对隧道火灾样本的利用率,并在此基础上利用成熟的机器学习方法,提出一种基于自注意力的隧道视频火灾识别技术。该技术采用自注意力机制结合SVM分类器搭建火焰识别模型,该模型针对各项特征对火焰识别的重要性分配不同的注意力权重,形成注意力矩阵,并将权重矩阵与特征向量的值相加权,通过SVM的Hinge Loss进行线性支持向量机分类,对公路隧道火灾进行识别和预警。在火灾识别训练过程中,通过对火焰疑似区域进行检测,并利用数据增强技术达到样本扩增的目的,随后采用多通道融合的特征提取方式构建特征向量,输入设计的自注意力火焰识别模型中,通过梯度下降优化器进行小批量模型训练,降低迭代次数,最终获得最优特征权重参数,得到最佳识别模型。试验结果表明,该方法在模型训练时收敛较快,在火焰识别时相比未使用小样本学习的传统SVM算法,准确率提高了5%,因此能在小样本环境下有效提高火灾识别的准确度。

Abstract: In view of the problem that the sample size of highway tunnel fire is small and the deep learning effect is not ideal, a small sample learning technology is studied to improve the full utilization of tunnel fire samples, and on this basis, a fire recognition technology of tunnel video based on self attention is proposed by using mature machine learning methods. The technology uses self-attention mechanism combined with SVM classifier to build a flame recognition model. According to the importance of each feature to flame recognition, the model assigns different attention weights to form the attention matrix, and weights the weight matrix with the value of the feature vector.Hinge Loss of SVM is used for linear support vector machine classification, so as to identify and warn highway tunnel fire.In the process of fire recognition training, through testing the flame suspected area, and use the data to enhance technology to achieve the purpose of the sample amplification, then the multi-modal fusion way of feature extraction was used to construct characteristic vector and input to the self-attention flame recognition model. Through the gradient descent optimizer, small batch model training is conducted, to reduce the number of iterations, Finally, the optimal feature weight parameters and the best recognition model are obtained. The experimental results show that the method converges faster during model training, and in flame identification, compared with the traditional SVM algorithm without small sample learning, the proposed method improves the accuracy by 5% in flame recognition, and can effectively improve the accuracy of fire recognition in a small sample environment.

Key words: tunnel video, video flame identification, small sample learning, self-attention mechanism, the SVM algorithm