Precise manipulation of GUI on a touch screen with haptic cues

Abstract

In this work, we designed a haptic stylus interface interacting with a touch screen. The stylus has functions of providing vibration, impact, and sound and it is a stand-alone system including its own battery and wireless communication module. We present a new interaction scheme on the Windows graphical user interface based on haptic feedback events for clicking, drag & drop, moving, scrolling, highlighting, and other things. From conducting experiments, we evaluated its performance that the haptic stylus improved precise control of GUI elements. A simple interactive digital sketchbook has been also implemented, which is providing haptic and auditory feedback while drawing and touching objects.