文献类型：期刊文献

中文题名：基于图像描述的实验室气瓶危险场景辨识方法

英文题名：Identification Method of Cylinder in Laboratory Dangerous Scene Based on Image Caption

作者：傅煦嘉[1];周家乐[1];顾震[1];颜秉勇[1];王慧锋[1]

机构：[1]华东理工大学信息科学与工程学院,上海200237

年份：2023

卷号：49

期号：3

起止页码：410

中文期刊名：华东理工大学学报（自然科学版）

外文期刊名：Journal of East China University of Science and Technology

收录：Scopus;北大核心:【北大核心2020】；CSCD:【CSCD_E2023_2024】；

基金：青年科学基金项目(61906068);国家重点研发计划(2018YFC1803306)。

语种：中文

中文关键词：气瓶监管;危险辨识;图像描述;多模态嵌入空间;Transformer模型

外文关键词：cylinder management;hazard identification;image caption;multi-modal embedding space;Transformer model

摘要：针对实验室气瓶场景提出了一种结合目标检测与文本检测识别的图像描述生成方法,用于辨识气瓶场景中的潜在危险信息,并以文本形式警示监控人员。该方法首先提取场景物体的特征与瓶身上文字的特征,而后将特征映射入多模态嵌入空间,接着使用Transformer模型生成描述结果,最后根据描述语句判断场景是否危险。实验结果表明,通过本方法生成的描述语句可以有效辨识出实验室气瓶场景中的危险物品与危险原因。
Cylinders are common equipment in the laboratory,which are characterized by large,quantity,high risk concealment and great accident harm.Therefore,cylinder supervision is very important for laboratory safety management.Video monitoring is an effective laboratory safety management means,but the monitoring videos need to be watched by specially assigned staff,and the ability of the quality of the surveillance personnel is different,so it cannot be guaranteed that they can identify dangerous information in the video pictures.Therefore,this paper proposes an image description generation method combining object detection and text recognition for the laboratory gas cylinder scene,which is used to identify the potential danger information in the cylinder scene and warn the monitoring personnel in the form of text.Firstly,the features of the scene object and the text on the cylinder body are extracted and mapped into the multi-modal embedding space.Then,Transformer structure is utilized to generate caption results.Finally,it is judged whether the scene is dangerous according to the description statement.It is shown from experimental results that the description statements generated by this method can effectively identify the dangerous substances and causes in the laboratory cylinder scene.