文献类型：期刊文献

中文题名：基于特征和图结构信息增强的多教师学习图神经网络

英文题名：Multi-teacher learning graph neural network based onfeature and graph structure information augmentation

作者：张嘉杰[1];过弋[1,2,3];王家辉[4]

机构：[1]华东理工大学信息科学与工程学院,上海200237;[2]大数据流通与交易技术国家工程实验室商业智能与可视化技术研究中心,上海200436;[3]上海大数据与互联网受众工程技术研究中心,上海200072;[4]上海第二工业大学计算机与信息工程学院,上海201209

年份：2023

卷号：40

期号：7

起止页码：2013

中文期刊名：计算机应用研究

外文期刊名：Application Research of Computers

收录：CSTPCD;;北大核心:【北大核心2020】；CSCD:【CSCD_E2023_2024】；

基金：上海市科学技术委员会科研计划项目(22DZ1204903,22511104800)。

语种：中文

中文关键词：图神经网络;知识蒸馏;数据增强;节点分类

外文关键词：graph neural network;knowledge distillation;data augmentation;node classification

摘要：近年来,图神经网络对图数据强大的表征能力和建模能力使其在诸多领域广泛应用并取得了重大突破。然而,现有模型往往倾向于对图卷积聚合策略和网络结构进行优化,缺乏了对图数据自身先验知识的探索。针对上述问题,通过知识蒸馏的方法,设计了一种基于特征信息和结构信息增强的多教师学习图神经网络,打破了现有模型对于数据先验知识提取的局限性。针对图数据背后所蕴涵的丰富特征与结构信息,分别设计了节点特征和边的数据增强方式。在此基础上,将原始数据和增强后的数据通过多教师学习模块进行知识嵌入,使得学生模型学习到更多关于数据的先验知识。在Cora、Citeseer和PubMed数据集上,节点分类准确率分别提升了1%、1.3%、1.1%。实验结果表明,提出的信息增强的多教师学习模型能够有效地捕获先验知识。
In recent years,the powerful representation and modeling capabilities of graph neural networks for graph data have made them widely used in many fields and made breakthroughs.However,the existing models tend to optimize the graph convolution aggregation strategy and network structure and lack the exploration of the prior knowledge of the graph data itself.In response to the above problems,this paper designed a multi-teacher learning graph neural network based on feature information and structural information enhancement through the method of knowledge distillation,which broke the limitations of existing models for data prior knowledge extraction.Given the rich features and structural information behind the graph data,this paper designed the data enhancement methods of node feature and edge respectively.On this basis,knowledge embedding was performed on the original data and the enhanced data through the multi-teacher learning module,so that the student model could learn more prior knowledge about the data.On the Cora,Citeseer,and PubMed datasets,the node classification accuracy increased by 1%,1.3%and 1.1%,respectively.Experimental results demonstrate that the information-augmented multi-teacher learning model proposed in this paper can effectively capture prior knowledge.