GRADWORK

For my graduation project, I developed a VR-based rehabilitation game focused on supporting individuals recovering from severe hand injuries. The research explored how gamification, delivered through consumer-grade VR hardware, could aid in relearning fine motor skills. The prototype was developed for the Oculus Quest 2 and used hand tracking as the primary interaction method. To achieve realistic interaction, I implemented a physics-based hand simulation driven by hand-tracking data. The rehabilitation exercises included a playable piano and a set of puzzle-based block interactions.

Piano

The piano was implemented using physics joints for each key, with the corresponding musical note playing when a key is pressed. Building on this system, I added support for playing arbitrary piano MIDI files. During MIDI playback, the piano keys animate physically, accurately reflecting the performance.