Unsupervised Activity Perception in Crowded and Complicated Scenes Using Hierarchical Bayesian Models
Author(s)
Wang, Xiaogang; Ma, Xiaoxu; Grimson, Eric
DownloadWang-2009-Unsupervised Activity Perception in Crowded and Complicated Scenes Using Hierarchical Bayesian Models.pdf (4.602Mb)
PUBLISHER_POLICY
Publisher Policy
Article is made available in accordance with the publisher's policy and may be subject to US copyright law. Please refer to the publisher's site for terms of use.
Terms of use
Metadata
Show full item recordAbstract
We propose a novel unsupervised learning framework to model activities and interactions in crowded and complicated scenes. Hierarchical Bayesian models are used to connect three elements in visual surveillance: low-level visual features, simple "atomic" activities, and interactions. Atomic activities are modeled as distributions over low-level visual features, and multi-agent interactions are modeled as distributions over atomic activities. These models are learnt in an unsupervised way. Given a long video sequence, moving pixels are clustered into different atomic activities and short video clips are clustered into different interactions. In this paper, we propose three hierarchical Bayesian models, Latent Dirichlet Allocation (LDA) mixture model, Hierarchical Dirichlet Process (HDP) mixture model, and Dual Hierarchical Dirichlet Processes (Dual-HDP) model. They advance existing language models, such as LDA [1] and HDP [2]. Our data sets are challenging video sequences from crowded traffic scenes and train station scenes with many kinds of activities co-occurring. Without tracking and human labeling effort, our framework completes many challenging visual surveillance tasks of board interest such as: (1) discovering typical atomic activities and interactions; (2) segmenting long video sequences into different interactions; (3) segmenting motions into different activities; (4) detecting abnormality; and (5) supporting high-level queries on activities and interactions.
Date issued
2008-04Department
Massachusetts Institute of Technology. Computer Science and Artificial Intelligence LaboratoryJournal
IEEE Transactions on Pattern Analysis and Machine Intelligence
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Citation
Xiaogang Wang, Xiaoxu Ma, and W.E.L. Grimson. “Unsupervised Activity Perception in Crowded and Complicated Scenes Using Hierarchical Bayesian Models.” IEEE Transactions on Pattern Analysis and Machine Intelligence 31.3 (2009): 539–555. © Copyright 2009 IEEE
Version: Final published version
ISSN
0162-8828
2160-9292