文献类型：期刊文献

中文题名：基于三维卷积神经网络的虫音特征识别方法

英文题名：Insect sound feature recognition method based on three-dimensional convolutional neural network

作者：万永菁[1];王博玮[1];娄定风[2]

机构：[1]华东理工大学信息科学与工程学院,上海200237;[2]深圳海关,广东深圳518045

年份：2019

卷号：39

期号：9

起止页码：2744

中文期刊名：计算机应用

外文期刊名：journal of Computer Applications

收录：CSTPCD;;北大核心:【北大核心2017】；CSCD:【CSCD_E2019_2020】；

基金：国家自然科学基金资助项目(61872143);国家大学生创新创业训练计划项目(201810251064)~~

语种：中文

中文关键词：三维卷积神经网络;短时傅里叶变换;语谱图;虫音识别;声学信号处理

外文关键词：Three-Dimensional Convolutional Neural Network(3D CNN);Short-Time Fourier Transform(STFT);spectrogram;insect sound detection;acoustic signal processing

摘要：进口木材蛀虫检疫是海关的一项重要工作,但其存在着虫声检测算法准确率低、鲁棒性差等问题。针对这些问题,提出了一种基于三维卷积神经网络(3D CNN)的虫音检测方法以实现虫音特征的识别。首先,对原始虫音音频进行交叠分帧预处理,并使用短时傅里叶变换得到虫音音频的语谱图;然后,将语谱图作为3D CNN的输入,使其通过包含三层卷积层的3D CNN以判断音频中是否存在虫音特征。通过设置不同分帧长度下的输入进行网络训练及测试;最后以准确率、F 1分数以及ROC曲线作为评估指标进行性能分析。结果表明,在交叠分帧长度取5 s时,训练及测试效果最佳。此时,3D CNN模型在测试集上的准确率达到96.0%,F 1分数为0.96,且比二维卷积神经网络(2D CNN)模型准确率提高近18%。说明所提算法能准确地从音频信号中提取虫音特征并完成蛀虫识别任务,为海关检验检疫提供有力保障。
The quarantine of imported wood is an important task for the customs,but there are problems such as low accuracy and poor robustness in the insect sound detection algorithm.To solve these problems,an insect sound detection method based on Three-Dimensional Convolutional Neural Network(3D CNN)was proposed to detect the presence of insect sound features.Firstly,the original insect audio was framed and pre-processed,and Short-Time Fourier Transform(STFT)was operated to obtain the spectrogram of the insect audio.Then,the spectrogram was used as the input of the 3D CNN consisting three convolutional layers.Network training and testing were conducted by setting inputs with different framing lengths.Finally,the analysis of performance was carried out using metrics like accuracy,F 1 score and ROC curve.The experiments showed that the test results were best when the overlap framing length was 5 seconds.The best result of the 3D CNN model on the test set achieved an accuracy of 96.0%and an F 1 score of 0.96.The accuracy was increased by nearly 18%compared with that of the two-dimensional convolutional neural network(2D CNN)model.It shows that the proposed model can extract the insect sound features from the audio signal more accurately and complete the insect identification task,which provides an engineering solution for customs inspection and quarantine.