文献类型：期刊文献

英文题名：Web image annotation based on Tri-relational Graph and semantic context analysis

作者：Zhang, Jing[1];Tao, Ti[1];Mu, Yakun[1];Sun, Han[1];Li, Dongdong[1];Wang, Zhe[1]

机构：[1]East China Univ Sci & Technol, Dept Comp Sci & Engn, Shanghai 200237, Peoples R China

年份：2019

卷号：81

起止页码：313

外文期刊名：ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE

收录：;EI(收录号：20191206651766);WOS:【SCI-EXPANDED(收录号:WOS:000468721700026)】；

基金：This research has been supported by the National Natural Science Foundation of China (Grant 61402174 and Grant 61672227).

语种：英文

外文关键词：Tri-relational graph; Semantic context analysis; Multilevel random walk with restart; Image label expansion

摘要：Web image annotation has became a hot research topic owing to massive image data and abundant semantic context. In this paper, we propose a Tri-relational Graph (TG) model for web image annotation, which comprises the image data graph, the region data graph and the label graph as subgraphs, and connects them by an additional tripartite graph induced from image segmentation results and label assignments. Through analyzing the global visual similarity between images, the visual similarity between regions, the semantic correlations between labels and the relationships between the three subgraphs by TG model, we perform multilevel Random Walk with Restart algorithm on TG to produce vertex-to-vertex relevance, including imageto-region, region-to-label and image-to-label relevances. Then semi-supervised learning is used to predict labels for unannotated image regions by inserting unlabeled images and their regions into TG. In addition, we also analyze the text context information of web image and achieve the semantic and proper nouns for the further label expansion through WordNet. Experiments on public web images datasets demonstrate that our proposed TG model and multilevel RWR algorithm can achieve good performance on image region annotation and outperform the similar image annotation methods. Moreover label expansion by web semantic context analysis can achieve more accurate and abundant annotation results.