Reinforcement Learning with Neural Networks: Essential Concepts
StatQuest with Josh Starmer via YouTube
Overview
This 24-minute video tutorial explains the fundamental concepts of reinforcement learning with neural networks. Learn how this powerful technique has enabled neural networks to win games, drive cars, and improve ChatGPT's human-like responses. Begin with a review of backpropagation before diving into why standard backpropagation falls short in certain scenarios. Discover how reinforcement learning overcomes these limitations by using guesses to calculate derivatives and rewards to update them. Explore alternative reward structures and see practical examples of parameter updates through reinforcement learning. The tutorial includes clear explanations with two detailed examples and concludes with a comprehensive summary of this essential machine learning approach.
Syllabus
0:00 Awesome song and introduction
4:01 Backpropagation review
6:25 The problem with standard backpropagation
7:04 Taking a guess to calculate the derivative
11:20 Using a reward to update the derivative
14:56 Alternative rewards
16:01 Updating a parameter with the updated derivative
16:56 A second example
22:05 Summary
Taught by
StatQuest with Josh Starmer