A framework for enhancing the sense of presence in virtual and mixed reality

Abstract

The vision of virtual reality has always been to create worlds that look, sound, act, and feel real. However, researchers and developers have largely favored visual perception over other senses. This over-valuation of the visual may be traced back to a partial interpretation of the seminal work on visual perception by psychologist JJ Gibson. Oculocentrism in design overlooks the fact that Gibson's theory of perception encompasses the entire range of perceptual processes integrated with action, including kinesthesia and affordances of the environment. Starting with Gibson's ecological approach to the reality of experience, I develop a four-dimensional framework for creating immersive experiences that blend extrinsic elements, meaning elements related to the user's real world context, and intrinsic elements, i.e., those related to the device, application and content. I present a series of novel methods and techniques, demonstrated through implemented systems to show how transferring real world affordances to virtual experiences can enhance the sense of presence, while also arguing for a shift from oculocentrism to sensorimotor processes and to the experiential modalities of touch, proprioception, and kinesthesia. My work contrasts with the currently dominant design approach premised on the notion that the richness of sensory perception can be recreated with vision alone. The hybrid systems described in this thesis present techniques for integrating space, kinesthesia, touch and other sensations, social interaction, and the user's physiology into the virtual experience.