One of the best course. I have learned since their machine learning course and love the interaction between the lecturer. Some people complained about the slow pace, but there is actually a simplify version of RL in the ML class I've mentioned. Go check it out if you don't have time. This course supposed to go "deep". And believe me, the RL course you might take in the college or grad school is much more "slow paced" than this one.
- They let student to think along the way, not just cram the stuffs into our head
- A sense of humor in teaching the class
- Lack of support on the homework, as well as using framework BURLAP require steep learning curve
- Some context such as TD(0) and TD(1) can be explained more intuitively (maybe it's just me not quite understand that part)