文献类型：期刊文献

英文题名：A complementary facial representation extracting method based on deep learning

作者：Sun, Wenyun[1,2];Zhao, Haitao[3];Jin, Zhong[1,2]

机构：[1]Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing, Jiangsu, Peoples R China;[2]Nanjing Univ Sci & Technol, Key Lab Intelligent Percept & Syst High Dimens In, Minist Educ, Nanjing, Jiangsu, Peoples R China;[3]East China Univ Sci & Technol, Sch Informat Sci & Engn, Shanghai, Peoples R China

年份：2018

卷号：306

起止页码：246

外文期刊名：NEUROCOMPUTING

收录：;EI(收录号：20182105221317);WOS:【SCI-EXPANDED(收录号:WOS:000433212700021)】；

基金：This work is partially supported by National Natural Science Foundation of China under Grant Nos. 61373063, 61375007, U1713208, 61602244, 61702262, 91420201, 61472187 and by National Basic Research Program of China under Grant No. 2014CB349303, and by Pre-Research Area Foundation of China under Grant No. 6140312010101.

语种：英文

外文关键词：Complementary facial representation; Facial expression; Deep learning

摘要：The identification and expression are two orthogonal properties of faces. But, few studies considered the two properties together. In this paper, the two properties are modeled in a unified framework. A pair of 18-layered Convolutional Deconvolutional Networks (Conv-Deconv) is proposed to learn a bidirectional mapping between the emotional expressions and the neutral expressions. One network extracts the complementary facial representations (i.e. identification representations and emotional representations) from emotional faces. The other network reconstructs the original faces from the extracted representations. Two networks are mutually inverse functions. Based on the framework, the networks are extended for various tasks, including face generation, face interpolation, facial expression recognition, and face verification. A new facial expression dataset called Large-scale Synthesized Facial Expression Dataset (LSFED) is presented. The dataset contains 105,000 emotional faces of 15,000 subjects synthesized by computer graphics program. Its distorted version (LSFED-D) is also presented to increase the difficulty and mimic real-world conditions. Good experiment results are obtained after evaluating our method on the synthesized clean LSFED dataset, the synthesized distorted LSFED-D dataset, and the real-world RaFD dataset. (C) 2018 Elsevier B.V. All rights reserved.