FINGER TRACKING FOR HUMAN COMPUTER INTERFACE USING MULTIPLE SENSOR DATA FUSION

Abstract

As human-computer interface advances from two to three dimensions, new input devices are required to allow low-cost learning and increased human involvement in virtual reality contexts. In this study, we offer a small, finger-worn, wireless motion tracking platform that can be reprogrammed for a number of functions to enhance mobile computing. First, it functions as a wireless mouse in the air without requiring a surface for a mouse or trackpad, making it appropriate for augmented-reality or virtual-reality systems. Second, it supports single-finger motion tracking in its entirety. A more complex version is able to mix information from more units on multiple fingers to create a greater variety of options. The prototype of our ring will have an ultra-compact wireless sensing platform with an on-board triaxial accelerometer, triaxial magnetometer, triaxial gyroscope, and a short-range wireless Bluetooth transmitter with a Time-of-Flight (TOF) sensor for finger flexion detection. Quantitative and qualitative evaluations of the accuracy and usefulness of the Inertial measurement unit (IMU) sensor breakout board have been conducted. The results demonstrate that the Inertial measurement unit (IMU) sensor finger tracking system is intuitive for mouse-like tasks.