NFNets - High-Performance Large-Scale Image Recognition Without Normalization

NFNets - High-Performance Large-Scale Image Recognition Without Normalization

Yannic Kilcher via YouTube Direct link

- Intro & Overview

1 of 12

1 of 12

- Intro & Overview

Class Central Classrooms beta

YouTube playlists curated by Class Central.

Classroom Contents

NFNets - High-Performance Large-Scale Image Recognition Without Normalization

Automatically move to the next video in the Classroom when playback concludes

  1. 1 - Intro & Overview
  2. 2 - What's the problem with BatchNorm?
  3. 3 - Paper contribution Overview
  4. 4 - Beneficial properties of BatchNorm
  5. 5 - Previous work: NF-ResNets
  6. 6 - Adaptive Gradient Clipping
  7. 7 - AGC and large batch size
  8. 8 - AGC induces implicit dependence between training samples
  9. 9 - Are BatchNorm's problems solved?
  10. 10 - Network architecture improvements
  11. 11 - Comparison to EfficientNet
  12. 12 - Conclusion & Comments

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.