文献类型：期刊文献

英文题名：Adversarial Semantic Augmentation for Training Generative Adversarial Networks under Limited Data

作者：Yang, Mengping[1,2]; Wang, Zhe[1,2]; Chi, Ziqiu[1,2]; Li, Dongdong[2]; Du, Wenli[1]

机构：[1] Key Laboratory of Smart Manufacturing in Energy Chemical Process, Ministry of Education, East China University of Science and Technology, Shanghai, 200237, China; [2] Department of Computer Science & Engineering, East China University of Science & Technology, Shanghai, 200237, China

年份：2025

外文期刊名：arXiv

收录：EI(收录号：20250076662)

语种：英文

外文关键词：Adversarial machine learning - Data assimilation

摘要：Generative adversarial networks (GANs) have made remarkable achievements in synthesizing images in recent years. Typically, training GANs requires massive data, and the performance of GANs deteriorates significantly when training data is limited. To improve the synthesis performance of GANs in low-data regimes, existing approaches use various data augmentation techniques to enlarge the training sets. However, it is identified that these augmentation techniques may leak or even alter the data distribution. To remedy this, we propose an adversarial semantic augmentation (ASA) technique to enlarge the training data at the semantic level instead of the image level. Concretely, considering semantic features usually encode informative information of images, we estimate the covariance matrices of semantic features for both real and generated images to find meaningful transformation directions. Such directions translate original features to another semantic representation, e.g., changing the backgrounds or expressions of the human face dataset. Moreover, we derive an upper bound of the expected adversarial loss. By optimizing the upper bound, our semantic augmentation is implicitly achieved. Such design avoids redundant sampling of the augmented features and introduces negligible computation overhead, making our approach computation efficient. Extensive experiments on both few-shot and large-scale datasets demonstrate that our method consistently improve the synthesis quality under various data regimes, and further visualized and analytic results suggesting satisfactory versatility of our proposed method. ? 2025, CC BY.