文献类型：期刊文献

英文题名：Soft variable selection combining partial least squares and attention mechanism for multivariable calibration

作者：Xiong, Yinran[1];Yang, Wuye[1];Liao, Huiyun[2];Gong, Zhenlin[2];Xu, Zhenzhen[1];Du, Yiping[1];Li, Wei[2]

机构：[1]East China Univ Sci & Technol, Sch Chem & Mol Engn, Shanghai Key Lab Funct Mat Chem, Shanghai 200237, Peoples R China;[2]China Tobacco Jiangsu Ind Co Ltd, Nanjing 210019, Peoples R China

年份：2022

卷号：223

外文期刊名：CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS

收录：;EI(收录号：20242616373444);WOS:【SCI-EXPANDED(收录号:WOS:000782981400001)】；

语种：英文

外文关键词：Variable selection; Attention mechanism; Partial least square; Near infrared spectroscopy

摘要：Partial least squares (PLS) are a widely used algorithm for building a linear model between chemical properties and multivariables. Due to the abundant features and relatively few calibration samples, variable selection is usually adopted to eliminate uninformative variables and restrain overfitting. In this study, a new variable selection method, called 'Attention-PLS' was proposed, combining PLS with the attention mechanism in a neural network. The attention mechanism tries to find a new combination of the variables, and owing to the property of softmax function, only few variables' weights are dominant in the new combination's weights. Attention-PLS is a soft way of variable selection, as it does not absolutely eliminate the influence of the unimportant variables but enlarge their difference of variables' weights by using softmax function to normalize the weights. Attention-PLS is compared with some common methods like ordinary partial least squares, Least Absolute Shrinkage and Selection Operator (LASSO), Ridge Regression (RR), Monte Carlo based uninformative variable elimination (MC-UVE), and Sparse Partial Least Square (SPLS), which are applied to three near infrared spectral (NIR) datasets. The results show that the proposed method has better prediction performances.