A novel video game peripheral for detecting fine hand motion and providing haptic feedback

Abstract

This thesis documents the design and implementation of a game controller glove that employs optical tracking technology to detect movement of the hand and fingers. The vision algorithm captures an image from a webcam in real-time and determines the centroids of colored sections on a glove worn by the player; assigning a distinctive identifier for each section which is associated with a 3D model retrieved from a preexisting library. A Vivitouch artificial muscle module is also mounted to the top of the glove to provide vibratory haptic feedback to the user. The system has been user tested and a number of potential use scenarios have been conceived for integration of the controller in various gaming applications.