Homework problems were taken from the course textbook:
Bertsekas, Dimitri P. Dynamic Programming and Optimal Control, Volume I. 3rd ed. Athena Scientific, 2005. ISBN: 9781886529267.
———. Dynamic Programming and Optimal Control, Volume II: Approximate Dynamic Programming. 4th ed. Athena Scientific, 2012. ISBN: 9781886529441.
Errata (PDF)
Approximate dynamic programming online chapter (
PDF - 2.1MB)
Course assignments.
| ASSN # | PROBLEMS |
| 1 | Volume I: 1.3, 1.22, 1.23, 2.1 |
| 2 | 2.7, 3.1, 4.1, 4.4 |
| 3 | 4.16, 4.20, 4.21, 4.24 |
| 4 | 5.2, 5.5, 5.7, 5.8, 5.16, 6.2 (ignore OLFC part) |
| 5 | 7.4, 7.5, 7.7, 7.8a |
| 6 | 7.17, 7.18, 7.23, 7.25 |
| 7 | Volume II: 2.9, 2.11 |
| 8 | 3.2, 3.13 |
| 9 | 3.6, 6.4 of the online chapter |