Overview
This course aims to teach learners about the optimization of matrix multiplication algorithms using Deep Reinforcement Learning. The course covers topics such as matrix multiplication, tensor decompositions, and the discovery of efficient algorithms through reinforcement learning. The teaching method involves a combination of theoretical explanations, practical examples, and a demonstration of the AlphaTensor algorithm. This course is intended for individuals interested in advanced topics in mathematics, artificial intelligence, and algorithm optimization.
Syllabus
- Intro
- Sponsor: Assembly AI link in description
- What even is Matrix Multiplication?
- A very astounding fact
- Trading multiplications for additions
- Matrix Multiplication as a Tensor
- Tensor Decompositions
- A formal way of finding multiplication algorithms
- How to formulate this as a game?
- A brief primer on AlphaZero / MCTS
- The Results
- Optimizing for different hardware
- Expanding fundamental math
- Summary & Final Comments
Taught by
Yannic Kilcher