文献类型：期刊文献

英文题名：New design goal of a classifier: Global and local structural risk minimization

作者：Zhu, Changming[1,2];Wang, Zhe[2];Gao, Daqi[2]

机构：[1]Shanghai Maritime Univ, Coll Informat Engn, Shanghai 201306, Peoples R China;[2]E China Univ Sci & Technol, Dept Comp Sci & Engn, Shanghai 200237, Peoples R China

年份：2016

卷号：100

起止页码：25

外文期刊名：KNOWLEDGE-BASED SYSTEMS

收录：;EI(收录号：20161202133666);WOS:【SCI-EXPANDED(收录号:WOS:000374801000003)】；

基金：This work was partially supported by Natural Science Foundations of China under Grant Nos. 61272198 and 21176077, Innovation Program of Shanghai Municipal Education Commission under Grant no. 14ZZ054, the Fundamental Research Funds for the Central Universities, Shanghai Key Laboratory of Intelligent Information Processing of China under Grant no. IIPL-2012-003, and Soochow University Jiangsu Provincial Key Laboratory for Computer Information Processing Technology under Grant no. KJS1323.

语种：英文

外文关键词：Structural risk minimization; Global space and local space; Matrix learning; Local learning

摘要：Structural risk consists of empirical risk (training error) and Vapnik-Chemonenkis (VC) dimension (complexity). Since minimizing empirical risk makes a classifier have a high classification accuracy on label known patterns while minimizing complexity makes it have a low prediction error on label-unknown patterns, thus structural risk can be used to measure the effectiveness of a classifier and Structural Risk Minimization (SRM) becomes its design goal. Moreover, since a global space can be divided into several local ones, thus from the view of global space, the structural risk is named global structural risk while the one from the view of local space is named local structural risk. Traditional classifiers are designed based on global or local structural risk and their designs do not take both of them into account simultaneously. So this paper proposes a new design goal of a classifier with both global and local structural risks. Furthermore, a locality-sensitive term is introduced so as to measure the relationship between global structural risk and the local one. The new design goal is named Global and Local Structural Risk Minimization (GLSRM). Contribution of GLSRM is that it makes a classifier have a lower training error on label-known patterns and a lower prediction error on label-unknown ones in both global space and local spaces. Innovation of GLSRM is that it introduces a locality-sensitive term so as to reflect the relationship between global structural risk and the local one and then combines global structural risk, local structural risk, and their relationship together in the procedure of classifier design. Experiments on some real-world data sets show feasibility and effectiveness of GLSRM. (C) 2016 Elsevier B.V. All rights reserved.