Machine social intelligence in Virtualhome
Name
1227278318-MIT.pdf
Size
5.29 MB
Format
Adobe PDF
Checksum (MD5)
e59cd44a44b86e717a3efb360d8d2009
Author(s)
Li, Shuang,S.M.Massachusetts Institute of Technology.
Advisor(s)
Antonio Torralba.
Date Issued
2020
Publisher
Massachusetts Institute of Technology
Abstract
This thesis introduces a Watch-And-Help (WAH) challenge and a multi-agent environment for testing social intelligence in multiple agents. In the challenge, an AI agent needs to help a human-like agent perform a complex household task efficiently. To succeed, the AI agent needs to i) understand the underlying goal of the task by watching a single demonstration of the human-like agent performing the same task (social perception), and ii) coordinate with the human-like agent to solve the task in an unseen environment as fast as possible (human-AI collaboration). For this challenge, we build VirtualHome-Social, a multi-agent household environment, and provide a benchmark including both planning and learning based baselines. Experimental results demonstrate that in order to achieve success in the challenge, an AI agent has to accurately understand and predict the human-like agent's behaviors, and adapt its collaborative plan accordingly in novel environments.
Description
Thesis: S.M., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, September, 2020
Cataloged from student-submitted PDF version of thesis.
Includes bibliographical references (pages 49-53).
Subjects
Electrical Engineering and Computer Science.
MIT Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Terms of Use
MIT theses may be protected by copyright. Please reuse MIT thesis content according to the MIT Libraries Permissions Policy, which is available through the URL provided.
Persistent DSpace Link
