文献类型：期刊文献

英文题名：Hierarchical multihead self-attention for time-series-based fault diagnosis

作者：Wang, Chengtian[1];Shi, Hongbo[1];Song, Bing[1];Tao, Yang[1]

机构：[1]East China Univ Sci & Technol, Key Lab Smart Mfg Energy Chem Proc, Minist Educ, Shanghai 200237, Peoples R China

年份：2024

卷号：70

起止页码：104

外文期刊名：CHINESE JOURNAL OF CHEMICAL ENGINEERING

收录：;EI(收录号：20242116124187);WOS:【SCI-EXPANDED(收录号:WOS:001244264600001)】；

基金：This work is supported by the National Natural Science Foundation of China (62073140, 62073141) and the Shanghai Rising-Star Program (21QA1401800).

语种：英文

外文关键词：Self -attention mechanism; Deep learning; Chemical process; Fault diagnosis

摘要：Fault diagnosis is important for maintaining the safety and effectiveness of chemical process. Considering the multivariate, nonlinear, and dynamic characteristic of chemical process, many time-series-based data-driven fault diagnosis methods have been developed in recent years. However, the existing methods have the problem of long-term dependency and are difficult to train due to the sequential way of training. To overcome these problems, a novel fault diagnosis method based on time-series and the hierarchical multihead self-attention (HMSAN) is proposed for chemical process. First, a sliding window strategy is adopted to construct the normalized time-series dataset. Second, the HMSAN is developed to extract the time-relevant features from the time-series process data. It improves the basic self-attention model in both width and depth. With the multihead structure, the HMSAN can pay attention to different aspects of the complicated chemical process and obtain the global dynamic features. However, the multiple heads in parallel lead to redundant information, which cannot improve the diagnosis performance. With the hierarchical structure, the redundant information is reduced and the deep local timerelated features are further extracted. Besides, a novel many-to-one training strategy is introduced for HMSAN to simplify the training procedure and capture the long-term dependency. Finally, the effectiveness of the proposed method is demonstrated by two chemical cases. The experimental results show that the proposed method achieves a great performance on time-series industrial data and outperforms the state-of-the-art approaches. (c) 2024 The Chemical Industry and Engineering Society of China, and Chemical Industry Press Co., Ltd. All rights reserved.