Explore the concept of log softmax and its implementation in Python in this 12-minute tutorial video. Learn why log softmax is used to improve the numerical stability of softmax, starting with an introduction to softmax and the problem statement. Discover the challenges associated with softmax and dive into a hands-on solution. Follow along with code examples, including a Torch implementation. Gain insights into exp normalization tricks and explore interesting questions related to log probability optimization and the advantages of using log softmax over softmax in machine learning applications.
Overview
Syllabus
- Introduction:
- Softmax:
- Problem Statement:
- Problems with Softmax:
- Try it out! :
- Solution:
- Code:
- Torch Implementation:
Taught by
Yacine Mahdid
