2026-09-19T16:57:24Zhttps://dspace.mit.edu/server/oai/requestoai:dspace.mit.edu:1721.1/1449452022-08-30T03:29:57Zcom_1721.1_7582com_1721.1_7581col_1721.1_131023
Kaelbling, Leslie Pack
Lozano-Pérez, Tomás
Fang, Xiaolin
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
2022-08-29T16:22:43Z
2022-08-29T16:22:43Z
2022-05
2022-06-21T19:25:46.504Z
https://hdl.handle.net/1721.1/144945
For a robot operating in a daily household environment, generality is of great importance. It should be able to generalize to different tasks that involve different objects in varying backgrounds and configurations.
In this thesis, we will move towards this goal from two perspectives. We will first present a strategy for designing a robot manipulation system that can generalize to a wide range of goals, environments, and objects. Such generality is achieved through task and motion planning with affordances estimated by both learned and engineered modules. We demonstrate that this strategy can enable a single policy to perform a wide variety of real-world manipulation tasks. Next, we will present an interactive perception solution to deal with the uncertainty in the estimated affordances, with a focus on the segmentation of objects. We adopt an object-based belief representation to estimate the uncertainty coming from predicted segmentation, and select actions to reduce that efficiently. Our experiments show that our system can generalize better to different environments and reduce uncertainty more efficiently compared to our baselines.
S.M.
Massachusetts Institute of Technology
In Copyright - Educational Use Permitted
Copyright MIT
http://rightsstatements.org/page/InC-EDU/1.0/
Generalizable Robot Manipulation through Task and Motion Planning and Interactive Perception
Thesis
application/pdf
Master
Master of Science in Electrical Engineering and Computer Science
Publication
unknown
unknown
<Publication xmlns="https://www.openaire.eu/cerif-profile/1.1/" id="9490dbde-396e-4ff6-939f-59aa6ee12660">
<Type xmlns="https://www.openaire.eu/cerif-profile/vocab/COAR_Publication_Types">http://purl.org/coar/resource_type/c_1843</Type>
<Title>Generalizable Robot Manipulation through Task and Motion Planning and Interactive Perception</Title>
<PublishedIn>
<Publication>
</Publication>
</PublishedIn>
<PublicationDate>2022-05</PublicationDate>
<Authors>
<Author>
<DisplayName>Fang, Xiaolin</DisplayName>
<Affiliation>
<OrgUnit>
</OrgUnit>
</Affiliation>
</Author>
</Authors>
<Editors>
</Editors>
<Publishers>
<Publisher>
<DisplayName>Massachusetts Institute of Technology</DisplayName>
<OrgUnit />
</Publisher>
</Publishers>
<License>http://rightsstatements.org/page/InC-EDU/1.0/</License>
<Abstract>For a robot operating in a daily household environment, generality is of great importance. It should be able to generalize to different tasks that involve different objects in varying backgrounds and configurations.
In this thesis, we will move towards this goal from two perspectives. We will first present a strategy for designing a robot manipulation system that can generalize to a wide range of goals, environments, and objects. Such generality is achieved through task and motion planning with affordances estimated by both learned and engineered modules. We demonstrate that this strategy can enable a single policy to perform a wide variety of real-world manipulation tasks. Next, we will present an interactive perception solution to deal with the uncertainty in the estimated affordances, with a focus on the segmentation of objects. We adopt an object-based belief representation to estimate the uncertainty coming from predicted segmentation, and select actions to reduce that efficiently. Our experiments show that our system can generalize better to different environments and reduce uncertainty more efficiently compared to our baselines.</Abstract>
<Access xmlns="http://purl.org/coar/access_right"
>
</Access>
</Publication>