Lectures
| # | Date | Lecture Videos | Whiteboard Notes/Slides |
| 1. | January 5, 2022 | Introduction
Discussion | link
link |
| 2. | January 10, 2022 | MDP, Fundamental Theorem
Discussion | link
link |
| 3. | January 12, 2022 | Value and Policy Iteration
Discussion | link
link |
| 4. | January 17, 2022 | Policy Iteration and Local Planning
Discussion | link
link |
| 5. | January 19, 2022 | Local Planning
Discussion | link
link |
| 6. | January 24, 2022 | Local Planning (contd.)
Discussion | link
link |
| 7. | January 26, 2022 | Function Approximation
Discussion | link
link |
| 8. | January 31, 2022 | Approximate Policy Iteration
Discussion | link
link |
| 9. | February 2, 2022 | Approximate Policy Iteration (contd.)
Discussion | link
link |
| 10. | February 7, 2022 | Planning Complexity
Discussion | link
link |
| 11. | February 9, 2022 | Planning Complexity: TensorPlan
Discussion | link
link |
| 12. | February 14, 2022 | Planning Complexity: TensorPlan (contd.)
Discussion | link
link |
| 13. | February 16, 2022 | Lower Bound for API and POLITEX
Discussion | link
link |
| 14. | February 28, 2022 | POLITEX (contd.)
Discussion | link |
| 15. | March 2, 2022 | Policy Search
Discussion | link |
| 16. | March 7, 2022 | Policy Search (contd.)
Discussion | link |
| 17. | March 9, 2022 | Batch RL: Introduction
Discussion | link |
| 18. | March 14, 2022 | Batch RL: Finite MDPs
Discussion | link |
| 19. | March 16, 2022 | Batch RL: Function approximation
Discussion | link |
| 20. | March 21, 2022 | Batch RL 4
Discussion | link |
| 21. | March 23, 2022 | Batch Excursion (contd.)
Discussion | link |
| 22. | March 28, 2022 | Online RL
Discussion | link |
| 23. | March 30, 2022 | Online RL 2
Discussion | link |
| 24. | April 4, 2022 | Online RL 3
Discussion | link |