R.E.I.N.A. : towards pervasive interface agents that transcend the physical-digital worlds

Abstract

Our generation is spending more time in front of computer screens, in part due to the onset of the COVID-19 pandemic. In front of our screens, we see multiple notes, folders, windows, and applications that somehow replicate a metaphoric desk. The way we navigate this digital system has not changed much in the past four decades. However, in the last two years, the technological landscape is showing sign of a potential shift that could enable novel ways of navigating the physical and digital information spaces. Augmented and virtual reality systems are spinning off from laboratories around the world, promising to offer better ways of storytelling, learning, working, and interacting. Just like how window interfaces became established with the development of computer graphics, and voice assistants with smartphones, augmented reality could generate a new natural multi-modal interface for enhancing our interactions with the physical and digital worlds. In this thesis, I am introducing the concept of a Pervasive Interface Agent, a cross-platform agent-based interface that acts as a lifelong companion, assisting us autonomously in both physical and digital worlds. Additionally, I am presenting R.E.I.N.A., a phase 1 prototype of a Pervasive Interface Agent together with the Media Lab Tour Guiding System. A set of experiments called the R.E.I.N.A. experiment were designed and conducted on 101 international participants to gain insights on the effect of agent embodiment in a remote tour guiding experience. The results are also discussed in this work.