2026-09-19T21:34:14Zhttps://dspace.mit.edu/server/oai/requestoai:dspace.mit.edu:1721.1/466382022-01-13T07:54:36Zcom_1721.1_7582com_1721.1_7581col_1721.1_131023
Russ Tedrake.
Roberts, John W., Ph. D. Massachusetts Institute of Technology
Massachusetts Institute of Technology. Dept. of Mechanical Engineering.
Massachusetts Institute of Technology. Department of Mechanical Engineering
2009-08-26T17:09:49Z
2009-08-26T17:09:49Z
2009
2009
http://hdl.handle.net/1721.1/46638
426489366
Thesis (S.M.)--Massachusetts Institute of Technology, Dept. of Mechanical Engineering, 2009.
Includes bibliographical references (p. 71-75).
Creatures in nature have subtle and complicated interactions with their surrounding fluids, achieving levels of performance as yet unmatched by engineered solutions. Model-free reinforcement learning (MFRL) holds the promise of allowing man-made controllers to take advantage of the subtlety of fluid-body interactions solely using data gathered on the actual system to be controlled. In this thesis, improved MFRL algorithms, motivated by a novel Signal-to-Noise Ratio for policy gradient algorithms, are developed, and shown to provide more efficient learning in noisy environments. These algorithms are then demonstrated on a heaving foil, where it is shown to learn a flapping gait on an experimental system orders of magnitude faster than the dynamics can be simulated, suggesting broad applications both in controlling robots with complex dynamics and in the study of controlled fluid systems.
by John W. Roberts.
S.M.
75 p.
eng
Massachusetts Institute of Technology
M.I.T. theses are protected by
copyright. They may be viewed from this source for any purpose, but
reproduction or distribution in any format is prohibited without written
permission. See provided URL for inquiries about permission.
http://dspace.mit.edu/handle/1721.1/7582
Mechanical Engineering.
Motor learning on a heaving plate via improved-SNR algorithms
Motor learning on a heaving plate via improved-Signal-to-Noise Ratio algorithms
Thesis
application/pdf
false
Publication
unknown
unknown
<Publication xmlns="https://www.openaire.eu/cerif-profile/1.1/" id="6b029dc7-9e98-4842-9308-1309398d89e9">
<Type xmlns="https://www.openaire.eu/cerif-profile/vocab/COAR_Publication_Types">http://purl.org/coar/resource_type/c_1843</Type>
<Language>eng</Language>
<Title>Motor learning on a heaving plate via improved-SNR algorithms</Title>
<Subtitle>Motor learning on a heaving plate via improved-Signal-to-Noise Ratio algorithms</Subtitle>
<PublishedIn>
<Publication>
</Publication>
</PublishedIn>
<PublicationDate>2009</PublicationDate>
<Authors>
<Author>
<DisplayName>Roberts, John W., Ph. D. Massachusetts Institute of Technology</DisplayName>
<Affiliation>
<OrgUnit>
</OrgUnit>
</Affiliation>
</Author>
</Authors>
<Editors>
</Editors>
<Publishers>
<Publisher>
<DisplayName>Massachusetts Institute of Technology</DisplayName>
<OrgUnit />
</Publisher>
</Publishers>
<License>http://dspace.mit.edu/handle/1721.1/7582</License>
<Keyword>Mechanical Engineering.</Keyword>
<Abstract>Creatures in nature have subtle and complicated interactions with their surrounding fluids, achieving levels of performance as yet unmatched by engineered solutions. Model-free reinforcement learning (MFRL) holds the promise of allowing man-made controllers to take advantage of the subtlety of fluid-body interactions solely using data gathered on the actual system to be controlled. In this thesis, improved MFRL algorithms, motivated by a novel Signal-to-Noise Ratio for policy gradient algorithms, are developed, and shown to provide more efficient learning in noisy environments. These algorithms are then demonstrated on a heaving foil, where it is shown to learn a flapping gait on an experimental system orders of magnitude faster than the dynamics can be simulated, suggesting broad applications both in controlling robots with complex dynamics and in the study of controlled fluid systems.</Abstract>
<Access xmlns="http://purl.org/coar/access_right"
>
</Access>
</Publication>