Please note that these are exercise numbers from the real
book.
The numbers in the electronic version may differ.
Programming Exercise:
Due: Tuesday, November 2nd
Obtain the software here.
The command to unpack the tar file is: tar
-xf A6Programming.tar
1) The file sarsa.py contains an incomplete Sarsa agent.
Complete it by adding one line of code implementing the key equation of
Sarsa. Turn in your single added line.
2) Run the Sarsa algorithm on the windy gridworld with King's moves and
stochastic wind (exercise 6.7) for 5000 episodes and turn in your
results.
Submission
instructions
Please hand in a hard copy of the assignment at the beginning of class
on the due date. Back
to Main Page
