文献类型：期刊文献

中文题名：基于Leapmotion的VR钢琴及手势识别的设计与实现

英文题名：Design and implementation of VR piano and gesture recognition based on leapmotion

作者：周家乐[1];贺元昭[1];章艺敏[1];顾睿杰[1];殷悦[1];杨富琴[1]

机构：[1]华东理工大学信息科学与工程学院,上海200237

年份：2020

卷号：31

期号：21

起止页码：5

中文期刊名：电子测试

外文期刊名：Electronic Test

语种：中文

中文关键词：LeapMotion;Unity3D;虚拟钢琴;手势识别;人机交互

外文关键词：leapmotion;unity3D;virtual piano;gesture recognition;human-computer interaction

摘要：随着数字信息化技术的快速发展,人们越来越倾向于使用自然、方便的方式实现人机交互。本文以Leapmotion传感器为硬件平台,以Unity3D和leapmotion插件为软件平台开发了一款虚拟钢琴的游戏。并且通过对leapmotion设备的开发研究,实现了通过算法对leapmotion传感器采集手势信息的处理识别,借助手势识别算法分出不同的手势以此来达成不同的响应。本文开发的虚拟钢琴极度还原现实中的钢琴,可以通过双手进行无实物演奏。可以运用于新式教育,钢琴音乐游戏等方面,具有广泛的推广应用价值。
With the rapid development of digital information technology,people are more and more inclined to use natural and convenient ways to realize human-computer interaction.In this paper,a virtual piano game is developed with leapmotion sensor as hardware platform and unity3d and leapmotion plug-in as software platform.And through the development and research of the leapmotion device,the processing and recognition of gesture information collected by the leapmotion sensor is realized through the algorithm,and different gestures are separated with the help of gesture recognition algorithm to achieve different responses.The virtual piano developed in this paper can extremely restore the real piano,which can be played by hands.It can be used in new education,piano,music games and other aspects,and has a wide range of application value.