Capturing Worlds of Play: A Framework for Educational Multiplayer Mixed Reality Simulations

Abstract

Multiplayer AR participatory simulations offer highly engaging hands-on lessons to teach systems thinking to K-12 students. However, several challenges obstruct the implementation of these simulations. These simulations require that participating mixed reality devices share a global view of the simulation. Devices must share a robust map of the physical space to render virtual objects in the same physical location for every viewer. In addition, the environmental data of the room must be captured and processed to inform the simulation. Finally, the system must respond dynamically to player input. This thesis project aims to create a framework that abstracts the process of building these highly dynamic AR p-sims.