文献类型：期刊文献

中文题名：基于Reformer模型的文本情感分析

英文题名：Chinese sentiment analysis based on Reformer model

作者：王珊[1];黄海燕[1];乔伟涛[1]

机构：[1]华东理工大学信息科学与工程学院,上海200237

年份：2022

卷号：43

期号：4

起止页码：1089

中文期刊名：计算机工程与设计

外文期刊名：Computer Engineering and Design

收录：CSTPCD;;北大核心:【北大核心2020】；

语种：中文

中文关键词：文本情感分析;深度学习;Reformer模型;局部敏感哈希注意力机制;可逆残差

外文关键词：text emotion analysis;deep learning;Reformer model;locality sensitive hashing attention;reversible residual

摘要：为提高中文文本情感分析任务的准确率,优化训练时长,提出基于Reformer的文本情感分析模型。利用Reformer模型的上下文语义编码能力,充分获得文本上下文的特征,提高文本分类准确率;在Transformer模型的基础上,引入局部敏感哈希注意力机制及可逆残差,降低模型的复杂度及内存的占用。在3个公开数据集上进行实验,实验结果表明,该模型在准确率及训练时间上均优于其它模型。
To improve the accuracy of Chinese text sentiment analysis tasks and to optimize the training time,a text sentiment analysis model based on Reformer was proposed.Based on Transformer model,the context semantic coding capability of the Reformer model was utilized,the characteristics of the text context were fully obtained,the accuracy of text classification was improved,and at the same time,locally sensitive hash attention mechanism and reversible residue were introduced,which reduced the complexity and memory utilization of the model.Experiments were performed on three publicly available data sets.Experimental results show that the proposed model is superior to other models in accuracy rate and training time.