Date of Graduation
Honors Research Project
Bachelor of Science in Computer Science
Computer Science - Systems
Willis Crissey, Jr
We present an implementation of a Natural User Interface (NUI) virtual piano keyboard. Using the Unity game engine and a Leap Motion hand controller, users are able to use their hands to interact with and play music in a virtual scene. Various approaches were attempted in refining the user experience of the virtual piano, and the successes and shortcomings of each implementation method are outlined and elaborated upon. Additionally, the most successful method, which was achieved by using Unity’s physics engine to detect rigid body collisions between virtual fingers and keys, was used to complete a usability study involving both experienced and amateur pianists. Subjects were presented with a series of playability tasks designed to gauge their ability to accurately use the virtual keyboard. Both the usability test data and the subject’s personal feedback were collected and analyzed.
Frazier, Zackery, "An Implementation and Usability Study of a Natural User Interface Virtual Piano" (2018). Honors Research Projects. 773.