Homework problems were taken from the course textbook:
Bertsekas, Dimitri P. Dynamic Programming and Optimal Control, Volume I. 3rd ed. Athena Scientific, 2005. ISBN: 9781886529267.
———. Dynamic Programming and Optimal Control, Volume II: Approximate Dynamic Programming. 4th ed. Athena Scientific, 2012. ISBN: 9781886529441.
Errata (PDF)
Approximate dynamic programming online chapter (
PDF - 2.1MB)
Course assignments.
ASSN # | PROBLEMS |
1 | Volume I: 1.3, 1.22, 1.23, 2.1 |
2 | 2.7, 3.1, 4.1, 4.4 |
3 | 4.16, 4.20, 4.21, 4.24 |
4 | 5.2, 5.5, 5.7, 5.8, 5.16, 6.2 (ignore OLFC part) |
5 | 7.4, 7.5, 7.7, 7.8a |
6 | 7.17, 7.18, 7.23, 7.25 |
7 | Volume II: 2.9, 2.11 |
8 | 3.2, 3.13 |
9 | 3.6, 6.4 of the online chapter |