Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

SynFlow - Pruning Neural Networks Without Any Data by Iteratively Conserving Synaptic Flow

Yannic Kilcher via YouTube

Overview

The course teaches a novel algorithm called SynFlow for pruning neural networks without the need for any data. The learning outcomes include understanding the Lottery Ticket Hypothesis, layer collapse in pruning algorithms, and the concept of synaptic saliency conservation. The course aims to equip learners with the skills to iteratively prune neural networks while conserving synaptic flow. The teaching method involves theoretical explanations, algorithm design, and experimental verification. The intended audience for this course includes individuals interested in deep learning, neural networks, and algorithm optimization.

Syllabus

- Intro & Overview
- Pruning Neural Networks
- Lottery Ticket Hypothesis
- Paper Story Overview
- Layer Collapse
- Synaptic Saliency Conservation
- Connecting Layer Collapse & Saliency Conservation
- Iterative Pruning avoids Layer Collapse
- The SynFlow Algorithm
- Experiments
- Conclusion & Comments

Taught by

Yannic Kilcher

Reviews

Start your review of SynFlow - Pruning Neural Networks Without Any Data by Iteratively Conserving Synaptic Flow

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.