文献类型：期刊文献

英文题名：Universal Foreground Segmentation Based on Deep Feature Fusion Network for Multi-Scene Videos

作者：Tao, Ye[1];Ling, Zhihao[1];Patras, Ioannis[2]

机构：[1]East China Univ Sci & Technol, Minist Educ, Key Lab Adv Control & Optimizat Chem Proc, Shanghai 200237, Peoples R China;[2]Queen Mary Univ London, Sch Elect Engn & Comp Sci, London E1 4NS, England

年份：2019

卷号：7

起止页码：158326

外文期刊名：IEEE ACCESS

收录：;EI(收录号：20200308055445);WOS:【SCI-EXPANDED(收录号:WOS:000510435700004)】；

基金：This work was supported in part by the Fundamental Research Funds for the Central Universities under Grant 222201917006.

语种：英文

外文关键词：Convolutional neural network; foreground segmentation; multi-scene videos aware

摘要：Foreground/background (fg/bg) classification is an important first step for several video analysis tasks such as people counting, activity recognition and anomaly detection. As is the case for several other Computer Vision problems, the advent of deep Convolutional Neural Network (CNN) methods has led to major improvements in this field. However, despite their success, CNN-based methods have difficulties in coping with multi-scene videos where the scenes change multiple times along the time sequence. In this paper, we propose a deep features fusion network based foreground segmentation method (DFFnetSeg), which is both robust to scene changes and unseen scenes comparing with competitive state-of-the-art methods. In the heart of DFFnetSeg lies a fusion network that takes as input deep features extracted from a current frame, a previous frame, and a reference frame and produces as output a segmentation mask into background and foreground objects. We show the advantages of using a fusion network and the three frames group in dealing with the unseen scene and bootstrap challenge. In addition, we show that a simple reference frame updating strategy enables DFFnetSeg to be robust to sudden scene changes inside video sequences and prepare a motion map based post-processing method which further reduces false positives. Experimental results on the test dataset generated from CDnet2014 and Lasiesta demonstrate the advantages of the DFFnetSeg method.