week03_model_free

Lecture slides - here

Materials

• Russian materials:
  • Lecture - video
  • Seminars
    • Q-learning seminar - video (older track - assignment)
    • SARSA & stuff - video
• English materials:
  • Lecture by David Silver (english) - video part I, video part II
  • Alternative lecture by Pieter Abbeel (english) - video
  • Alternative lecture by John Schulmann (english) - video
  • Blog post on q-learning Vs SARSA - url

More materials

• N-step temporal difference from Sutton's book - suttonbook chapter 7
• Eligibility traces from Sutton's book - suttonbook chapter 12
• Blog post on eligibility traces - url

Assignments

Just as usual, start with

• seminar_qlearning.ipynb Implement q-learning agent and test it on Taxi and CartPole with binarizer

and then proceed to

• homework.ipynb Implement EV-SARSA agent, experience replay + bonus tasks