Learning Emergent Gaits with Decentralized Phase Oscillators:
on the role of Observations, Rewards, and Feedback
Name
zhang-jenzhang-meng-eecs-2024-thesis.pdf
Description
Thesis PDF
Size
11.2 MB
Format
Adobe PDF
Checksum (MD5)
87ac5df70ccbca7d9d0e30c451716257
Author(s)
Zhang, Jenny L.
Advisor(s)
Kim, Sangbae
Date Issued
February 2024
Publisher
Massachusetts Institute of Technology
Abstract
We present a minimal phase oscillator model for learning quadrupedal locomotion. Each of the four oscillators is coupled only to itself and its corresponding leg through local feedback of the ground reaction force, which we interpret as an observer feedback gain. The oscillator itself is interpreted as a latent contact state-estimator. Through a systematic ablation study, we show that the combination of phase observations, simple phase-based rewards, and the local feedback dynamics induces policies that exhibit emergent gait preferences, while using a reduced set of simple rewards, and without prescribing a specific gait.
MIT Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Terms of Use
Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0)
Copyright retained by author(s)
Persistent DSpace Link