文献类型：会议论文

英文题名：Progress in Interpretability Research of Convolutional Neural Networks

作者：Zhang, Wei[1,2];Cai, Lizhi[1,2];Chen, Mingang[2];Wang, Naiqi[1,2]

机构：[1]East China Univ Sci & Technol, Sch Informat Sci & Engineer, Shanghai, Peoples R China;[2]Shanghai Dev Ctr Comp Software Technol, Lab Comp Software Testing & Evaluating, Shanghai, Peoples R China

会议论文集：10th European-Alliance-for-Innovation (EAI) International Conference on Mobile Computing, Applications, and Services (MobiCASE)

会议日期：JUN 14-15, 2019

会议地点：Hangzhou, PEOPLES R CHINA

语种：英文

外文关键词：Convolutional neural networks; black box; Interpretability

摘要：Convolutional neural networks have made unprecedented breakthroughs in various tasks of computer vision. Due to its complex nonlinear model structure and the high latitude and complexity of data distribution, it has been criticized as an unexplained "black box". Therefore, explaining the neural network model and uncovering the veil of the neural network have become the focus of attention. This paper starts with the term "interpretability", summarizes the results of the interpretability of convolutional neural networks in the past three years (2016-2018), and analyses them with interpretable methods. Firstly, the concept of "interpretability" is introduced. Then the existing research achievements are classified and compared from four aspects, data characteristics and rule processing, model internal spatial analysis, interpretation and prediction, and model interpretation. Finally pointed out the possible research directions.