An immersive system for browsing and visualizing surveillance video
Author(s)DeCamp, Philip James; Shaw, George Macaulay; Kubat, Rony Daniel; Roy, Deb K.
MetadataShow full item record
HouseFly is an interactive data browsing and visualization system that synthesizes audio-visual recordings from multiple sensors, as well as the meta-data derived from those recordings, into a unified viewing experience. The system is being applied to study human behavior in both domestic and retail situations grounded in longitudinal video recordings. HouseFly uses an immersive video technique to display multiple streams of high resolution video using a realtime warping procedure that projects the video onto a 3D model of the recorded space. The system interface provides the user with simultaneous control over both playback rate and vantage point, enabling the user to navigate the data spatially and temporally. Beyond applications in video browsing, this system serves as an intuitive platform for visualizing patterns over time in a variety of multi-modal data, including person tracks and speech transcripts.
DepartmentMassachusetts Institute of Technology. Department of Electrical Engineering and Computer Science; Massachusetts Institute of Technology. Media Laboratory; Program in Media Arts and Sciences (Massachusetts Institute of Technology)
ACM International Conference on Multimedia. Proceedings MM 2010
Association for Computing Machinery
DeCamp, Philip et al. “An immersive system for browsing and visualizing surveillance video.” Proceedings of the ACM International Conference on Multimedia, MM '10. ACM Press, 2010. 371. ©2010 ACM (Association of Computing Machinery)
Author's final manuscript