2026-09-19T04:26:51Zhttps://dspace.mit.edu/server/oai/requestoai:dspace.mit.edu:1721.1/855172026-06-06T00:49:40Zcom_1721.1_7582com_1721.1_7581col_1721.1_131023
Tomaso Poggio.
Wang, Chun-Kai, M. Eng. Massachusetts Institute of Technology
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science.
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
2014-03-06T15:47:43Z
2014-03-06T15:47:43Z
2013
2013
http://hdl.handle.net/1721.1/85517
871038300
Thesis: M. Eng., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2013.
Cataloged from PDF version of thesis.
Includes bibliographical references (pages 65-66).
Mouse tracking is integral to any attempt to automate mouse behavioral analysis in neuroscience. Systems that rely on vision have successfully tracked a single mouse in one cage[10], but when attempting to track multiple mice, video-based systems often struggle when the mice interact physically. In this thesis, I develop a novel vision-based tracking system that addresses the challenge of tracking multiple deformable mice with identical appearance, especially during complex occlusions. The system integrates both image and depth modalities to identify the boundary of two occluding mice, and then performs pose estimation to locate nose and tail locations of each mouse. Detailed performance evaluation shows that the system is robust and reliable, with low rate of identity swap after each occlusion event and accurate pose estimation during occlusion. To evaluate the tracking system, I introduce a dataset containing two 30-minute videos recorded with Microsoft's Kinect from the top view. Each video records the social reciprocal experiment of a pair of mice. I also explore applying the new tracking system to automated social behavior analysis, by detecting social interactions defined with position- and orientation-based features from tracking data. The preliminary results enable us to characterize lowered social activity of the Shank3 knockout mouse, and demonstrate the potential of this system for quantitaive study of mice social behavior.
by Chun-Kai Wang.
M.Eng.
66 pages
eng
Massachusetts Institute of Technology
M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission.
http://dspace.mit.edu/handle/1721.1/7582
Electrical Engineering and Computer Science.
Multiple mice tracking using Microsoft Kinect
Thesis
application/pdf
false
Publication
unknown
unknown
<Publication xmlns="https://www.openaire.eu/cerif-profile/1.1/" id="576749eb-5557-4f04-b423-3903197861d1">
<Type xmlns="https://www.openaire.eu/cerif-profile/vocab/COAR_Publication_Types">http://purl.org/coar/resource_type/c_1843</Type>
<Language>eng</Language>
<Title>Multiple mice tracking using Microsoft Kinect</Title>
<PublishedIn>
<Publication>
</Publication>
</PublishedIn>
<PublicationDate>2013</PublicationDate>
<Authors>
<Author>
<DisplayName>Wang, Chun-Kai, M. Eng. Massachusetts Institute of Technology</DisplayName>
<Affiliation>
<OrgUnit>
</OrgUnit>
</Affiliation>
</Author>
</Authors>
<Editors>
</Editors>
<Publishers>
<Publisher>
<DisplayName>Massachusetts Institute of Technology</DisplayName>
<OrgUnit />
</Publisher>
</Publishers>
<License>http://dspace.mit.edu/handle/1721.1/7582</License>
<Keyword>Electrical Engineering and Computer Science.</Keyword>
<Abstract>Mouse tracking is integral to any attempt to automate mouse behavioral analysis in neuroscience. Systems that rely on vision have successfully tracked a single mouse in one cage[10], but when attempting to track multiple mice, video-based systems often struggle when the mice interact physically. In this thesis, I develop a novel vision-based tracking system that addresses the challenge of tracking multiple deformable mice with identical appearance, especially during complex occlusions. The system integrates both image and depth modalities to identify the boundary of two occluding mice, and then performs pose estimation to locate nose and tail locations of each mouse. Detailed performance evaluation shows that the system is robust and reliable, with low rate of identity swap after each occlusion event and accurate pose estimation during occlusion. To evaluate the tracking system, I introduce a dataset containing two 30-minute videos recorded with Microsoft's Kinect from the top view. Each video records the social reciprocal experiment of a pair of mice. I also explore applying the new tracking system to automated social behavior analysis, by detecting social interactions defined with position- and orientation-based features from tracking data. The preliminary results enable us to characterize lowered social activity of the Shank3 knockout mouse, and demonstrate the potential of this system for quantitaive study of mice social behavior.</Abstract>
<Access xmlns="http://purl.org/coar/access_right"
>
</Access>
</Publication>