文献类型：期刊文献

英文题名：DeepFake detection method based on multi-scale interactive dual-stream network

作者：Cheng, Ziyuan[1];Wang, Yiyang[1];Wan, Yongjing[1];Jiang, Cuiling[1]

机构：[1]East China Univ Sci & Technol, Sch Informat Sci & Engn, Shanghai 200237, Peoples R China

年份：2024

卷号：104

外文期刊名：JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION

收录：;EI(收录号：20243616997336);WOS:【SCI-EXPANDED(收录号:WOS:001308199500001)】；

语种：英文

外文关键词：DeepFake detection; Multi-scale fusion; Interactive dual-stream; High-frequency noise

摘要：DeepFake face forgery has a serious negative impact on both society and individuals. Therefore, research on DeepFake detection technologies is necessary. At present, DeepFake detection technology based on deep learning has achieved acceptable results on high-quality datasets; however, its detection performance on low-quality datasets and cross-datasets remains poor. To address this problem, this paper presents a multi-scale interactive dual-stream network (MSIDSnet). The network is divided into spatial- and frequency-domain streams and uses a multi-scale fusion module to capture both the facial features of images that have been manipulated in the spatial domain under different circumstances and the fine-grained high-frequency noise information of forged images. The network fully integrates the features of the spatial- and frequency-domain streams through an interactive dual-stream module and uses vision transformer (ViT) to further learn the global information of the forged facial features for classification. Experimental results confirm that the accuracy of this method reached 99.30 % on the high-quality dataset Celeb-DF-v2, and 95.51 % on the low-quality dataset FaceForensics++. Moreover, the results of the cross-dataset experiments were superior to those of the other comparison methods.