文献类型：期刊文献

英文题名：Hierarchical CNN-based real-time fatigue detection system by visual-based technologies using MSP model

作者：Gu, Wang Huan[1];Zhu, Yu[1];Chen, Xu Dong[1];He, Lin Fei[1];Zheng, Bing Bing[1]

机构：[1]East China Univ Sci & Technol, Signal & Informat Proc, Shanghai, Peoples R China

年份：2018

卷号：12

期号：12

起止页码：2319

外文期刊名：IET IMAGE PROCESSING

收录：;EI(收录号：20184906212059);WOS:【SCI-EXPANDED(收录号:WOS:000451759800022)】；

基金：The authors greatly appreciate the financial supports of the Shanghai Science and Technology Committee under Grant nos. 17DZ1100808 and 17DZ1100803.

语种：英文

外文关键词：face recognition; learning (artificial intelligence); image resolution; object detection; computer vision; neural nets; cameras; feature extraction; pre-trained network;multitask CNN; face detection; eye; mouth regions; mouth state detection; MSP-Net; multiresolution input images; open mouth parameters; real-time system; hierarchical CNN-based real-time fatigue detection system; visual-based technologies; MSP model; driver; multitask hierarchical CNN scheme; convolutional neural network model; multiscale pooling

摘要：Visual-based technologies are very useful and meaningful to driver's fatigue detection. In this study, the authors present a multi-task hierarchical CNN scheme for fatigue detection system and propose a convolutional neural network (CNN) model with multi-scale pooling (MSP-Net). Multi-task' includes three tasks: face detection, eye and mouth state detection and fatigue detection. First, they use a pre-trained network - multi-task CNN for face detection extracting eye and mouth regions. Then, the main work of this study, eye and mouth state detection is processed by MSP-Net, which can fit multi-resolution input images captured from variant cameras excellently. For the third step, the percentage of eyelid closure over the pupil over time (PERCLOS) parameters and the frequency of open mouth (FOM) parameters are used to detect fatigue, and the FOM parameters are proposed by ourselves. Besides, they successfully port the system to the embedded platform (the NVIDIA JETSON TX2 development board) and test on real driving scene. The results show that their system performs well and is robust to complex environments and is in line with the demand of real-time system.