Link Search Menu Expand Document

Lectures

We will post the recorded lectures here.

# Date Lecture Videos Whiteboard Notes/Slides
1. January 5, 2022 Introduction
Discussion
link
link
2. January 10, 2022 MDP, Fundamental Theorem
Discussion
link
link
3. January 12, 2022 Value and Policy Iteration
Discussion
link
link
4. January 17, 2022 Policy Iteration and Local Planning
Discussion
link
link
5. January 19, 2022 Local Planning
Discussion
link
link
6. January 24, 2022 Local Planning (contd.)
Discussion
link
link
7. January 26, 2022 Function Approximation
Discussion
link
link
8. January 31, 2022 Approximate Policy Iteration
Discussion
link
link
9. February 2, 2022 Approximate Policy Iteration (contd.)
Discussion
link
link
10. February 7, 2022 Planning Complexity
Discussion
link
link
11. February 9, 2022 Planning Complexity: TensorPlan
Discussion
link
link
12. February 14, 2022 Planning Complexity: TensorPlan (contd.)
Discussion
link
link
13. February 16, 2022 Lower Bound for API and POLITEX
Discussion
link
link
14. February 28, 2022 POLITEX (contd.)
Discussion
link
15. March 2, 2022 Policy Search
Discussion
link
16. March 7, 2022 Policy Search (contd.)
Discussion
link
17. March 9, 2022 Batch RL: Introduction
Discussion
link
18. March 14, 2022 Batch RL: Finite MDPs
Discussion
link
19. March 16, 2022 Batch RL: Function approximation
Discussion
link
20. March 21, 2022 Batch RL 4
Discussion
link
21. March 23, 2022 Batch Excursion (contd.)
Discussion
link
22. March 28, 2022 Online RL
Discussion
link
23. March 30, 2022 Online RL 2
Discussion
link
24. April 4, 2022 Online RL 3
Discussion
link