Date of Last Revision
2023-05-03 05:19:02
Major
Computer Science - Systems
Degree Name
Bachelor of Science in Computer Science
Date of Expected Graduation
Spring 2018
Abstract
We present an implementation of a Natural User Interface (NUI) virtual piano keyboard. Using the Unity game engine and a Leap Motion hand controller, users are able to use their hands to interact with and play music in a virtual scene. Various approaches were attempted in refining the user experience of the virtual piano, and the successes and shortcomings of each implementation method are outlined and elaborated upon. Additionally, the most successful method, which was achieved by using Unity’s physics engine to detect rigid body collisions between virtual fingers and keys, was used to complete a usability study involving both experienced and amateur pianists. Subjects were presented with a series of playability tasks designed to gauge their ability to accurately use the virtual keyboard. Both the usability test data and the subject’s personal feedback were collected and analyzed.
Research Sponsor
Yingcai Xiao
First Reader
En Cheng
Second Reader
Willis Crissey, Jr
Recommended Citation
Frazier, Zackery, "An Implementation and Usability Study of a Natural User Interface Virtual Piano" (2018). Williams Honors College, Honors Research Projects. 773.
https://ideaexchange.uakron.edu/honors_research_projects/773