Open Pretrained Transformer - ML Coding Series

Open Pretrained Transformer - ML Coding Series

Aleksa Gordić - The AI Epiphany via YouTube Direct link

Intro - open pretrained transformer

1 of 14

1 of 14

Intro - open pretrained transformer

Class Central Classrooms beta

YouTube playlists curated by Class Central.

Classroom Contents

Open Pretrained Transformer - ML Coding Series

Automatically move to the next video in the Classroom when playback concludes

  1. 1 Intro - open pretrained transformer
  2. 2 Setup creating the cond env
  3. 3 Setup patch the code
  4. 4 Collecting train script arguments
  5. 5 Training script walk-through
  6. 6 Constructing a dummy task
  7. 7 Building the transformer model
  8. 8 CUDA kernels C++ code
  9. 9 Preparing a dummy dataset
  10. 10 Training loop
  11. 11 Zero grad loss scaling
  12. 12 Forward pass through a transformer
  13. 13 IMPORTANT loss, scaling, mixed precision, error handling
  14. 14 Outro

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.