INTRODUCTION

For my graduation work I made a VR Rehabilitation game. My research was towards people recovering from severe hand injuries and relearning their skills using gamification on consumer VR hardware. The demo was made for the Oculus quest 2. The interaction method used was hand tracking. I made a physics simulation of the hands using hand tracking data to achieve realistic results. The exercises consisted out of a piano and some puzzle blocks.

VIDEO

Piano

The playable piano works by using physics joints for the keys and once pressed the corresponding note plays. After implementing the playable keys I also added functionality to play any kind of piano midi file. When the midi files are playing the piano actually moves its keys.