2026-09-18T19:13:08Zhttps://dspace.mit.edu/server/oai/requestoai:dspace.mit.edu:1721.1/916972026-06-06T00:55:08Zcom_1721.1_7582com_1721.1_7581col_1721.1_131023
Patrick H. Winston.
McIntyre, Robert Louis
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science.
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
2014-11-24T16:16:19Z
2014-11-24T16:16:19Z
2014
2014
http://hdl.handle.net/1721.1/91697
894249493
Thesis: M. Eng., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2014.
This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.
Cataloged from student-submitted PDF version of thesis.
Includes bibliographical references (pages 83-85).
Here I demonstrate the power of using embodied artificial intelligence to attack the action recognition problem, which is the challenge of recognizing actions performed by a creature given limited data about the creature's actions, such as a video recording. I solve this problem in the case of a worm-like creature performing actions such as curling and wiggling. To attack the action recognition problem, I developed a computational model of empathy (EMPATH) which allows me to recognize actions using simple, embodied representations of actions (which require rich sensory data), even when that sensory data is not actually available. The missing sense data is imagined by combining previous experiences gained from unsupervised free play. The worm is a five-segment creature equipped with touch, proprioception, and muscle tension senses. It recognizes actions using only proprioception data. In order to build this empathic, action-recognizing system, I created a program called CORTEX, which is a complete platform for embodied AI research. It provides multiple senses for simulated creatures, including vision, touch, proprioception, muscle tension, and hearing. Each of these senses provides a wealth of parameters that are biologically inspired. CORTEX is able to simulate any number of creatures and senses, and provides facilities for easily modeling and creating new creatures. As a research platform it is more complete than any other system currently available.
by Robert Louis McIntyre.
M.Eng.
85 pages
eng
Massachusetts Institute of Technology
M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission.
http://dspace.mit.edu/handle/1721.1/7582
Electrical Engineering and Computer Science.
Recognizing actions using embodiment & empathy
Recognizing actions using embodiment and empathy
Thesis
application/pdf
false
Publication
unknown
unknown
<Publication xmlns="https://www.openaire.eu/cerif-profile/1.1/" id="9136da7a-b3f7-464c-b8bf-40c7fc66375f">
<Type xmlns="https://www.openaire.eu/cerif-profile/vocab/COAR_Publication_Types">http://purl.org/coar/resource_type/c_1843</Type>
<Language>eng</Language>
<Title>Recognizing actions using embodiment & empathy</Title>
<Subtitle>Recognizing actions using embodiment and empathy</Subtitle>
<PublishedIn>
<Publication>
</Publication>
</PublishedIn>
<PublicationDate>2014</PublicationDate>
<Authors>
<Author>
<DisplayName>McIntyre, Robert Louis</DisplayName>
<Affiliation>
<OrgUnit>
</OrgUnit>
</Affiliation>
</Author>
</Authors>
<Editors>
</Editors>
<Publishers>
<Publisher>
<DisplayName>Massachusetts Institute of Technology</DisplayName>
<OrgUnit />
</Publisher>
</Publishers>
<License>http://dspace.mit.edu/handle/1721.1/7582</License>
<Keyword>Electrical Engineering and Computer Science.</Keyword>
<Abstract>Here I demonstrate the power of using embodied artificial intelligence to attack the action recognition problem, which is the challenge of recognizing actions performed by a creature given limited data about the creature's actions, such as a video recording. I solve this problem in the case of a worm-like creature performing actions such as curling and wiggling. To attack the action recognition problem, I developed a computational model of empathy (EMPATH) which allows me to recognize actions using simple, embodied representations of actions (which require rich sensory data), even when that sensory data is not actually available. The missing sense data is imagined by combining previous experiences gained from unsupervised free play. The worm is a five-segment creature equipped with touch, proprioception, and muscle tension senses. It recognizes actions using only proprioception data. In order to build this empathic, action-recognizing system, I created a program called CORTEX, which is a complete platform for embodied AI research. It provides multiple senses for simulated creatures, including vision, touch, proprioception, muscle tension, and hearing. Each of these senses provides a wealth of parameters that are biologically inspired. CORTEX is able to simulate any number of creatures and senses, and provides facilities for easily modeling and creating new creatures. As a research platform it is more complete than any other system currently available.</Abstract>
<Access xmlns="http://purl.org/coar/access_right"
>
</Access>
</Publication>