文献类型：期刊文献

英文题名：ViT-LLMR: Vision Transformer-based lower limb motion recognition from fusion signals of MMG and IMU

作者：Zhang, Hanyang[1];Yang, Ke[1];Cao, Gangsheng[1];Xia, Chunming[1,2]

机构：[1]East China Univ Sci & Technol, Dept Mech Engn, Shanghai 200237, Peoples R China;[2]Shanghai Univ Engn Sci, Sch Mech & Automot Engn, Shanghai 201620, Peoples R China

年份：2023

卷号：82

外文期刊名：BIOMEDICAL SIGNAL PROCESSING AND CONTROL

收录：;EI(收录号：20230213376595);WOS:【SCI-EXPANDED(收录号:WOS:000921734100001)】；

语种：英文

外文关键词：Mechanomyography; Vision Transformer; Attention mechanism; Signal fusion

摘要：One of the key problems in lower limb-based human-computer interaction (HCI) technology is to use wearable devices to recognize the wearer's lower limb motions. The information commonly used to discriminate human motion mainly includes biological and kinematic signals. Considering that unimodal signals do not provide enough information to recognize lower limb movements, in this paper, we proposed a Vision Transformer (ViT)based architecture for lower limb motion recognition from multichannel Mechanomyography (MMG) signals and kinematic data. Firstly, we applied the self-attention mechanism to enhance each input channel signal. Then the data was fed into ViT model. Vision Transformer-based Lower Limb Motion Recognition (ViT - LLMR) architecture proposed in this paper can avoid the model training problems such as autonomous feature extraction and feature selection for machine learning, and the model can recognize eight lower limb motions containing six subjects with an accuracy of 94.62%. In addition, we analyzed the generalization ability of the model when undersampling and only collecting fragment signals. In conclusion, the proposed ViT - LLMR architecture could provide a basis for practical applications in different HCI fields.