文献类型：期刊文献

英文题名：Object aroused emotion analysis network for image sentiment analysis

作者：Zhang, Jing[1];Liu, Jiangpei[1];Ding, Weichao[1];Wang, Zhe[1]

机构：[1]East China Univ Sci & Technol, Dept Comp Sci & Engn, Shanghai, Peoples R China

年份：2024

卷号：286

外文期刊名：KNOWLEDGE-BASED SYSTEMS

收录：;EI(收录号：20240815577318);WOS:【SCI-EXPANDED(收录号:WOS:001174161800001)】；

基金：Acknowledgments This study was sponsored by the Natural Science Foundation of Shanghai, China (22ZR1418400 and 23ZR1414900) .

语种：英文

外文关键词：Image sentiment analysis; Object semantics; Object emotion distribution mapping; Visual attention mechanism

摘要：From cognitive psychology, objects are closely related to emotions, and inherently possess the ability to arouse human emotions. Hence, fully utilizing the relationships between objects and emotions can help achieve more accurate visual emotion recognition. In this paper, we propose a novel object aroused emotion analysis network to realize image sentiment classification by investigating the interactions between objects and emotions. To quantify the various emotion potencies of each object, a novel object emotion distribution module is proposed to explore the mapping among objects and emotions, and quantitatively demonstrate how various objects arouse different emotions. An object emotion -modeling mapping module is proposed to analyze the effect of objects and object combinations with emotion information on image sentiment; this module maps common objects to emotion dimensions and improves image sentiment classification with abundant object combination information. Then, we fuse the object -emotion mapping relation and multi -model features using BiGRU, thus realizing more accurate emotion recognition. Extensive experiments on widely used emotion datasets prove that our proposed method achieves excellent performance and outperforms most state-of-the-art image sentiment classification methods.