Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Inside TensorFlow - tf.data + tf.distribute

TensorFlow via YouTube

Overview

This course covers the best practices for tf.data and tf.distribute in TensorFlow. The learning outcomes include understanding how to build TensorFlow input pipelines, improve performance with the tf.data API, and implement distributed training with TensorFlow. The course teaches skills such as building input pipelines, optimizing performance, implementing parallel transformations, and utilizing the tf.distribute.Strategy API. The teaching method includes lectures and practical examples. The intended audience for this course is developers and data scientists familiar with TensorFlow looking to enhance their knowledge of tf.data and tf.distribute for improved performance and scalability in their machine learning projects.

Syllabus

Intro
ML Building Blocks
TensorFlow APIs
Why input pipeline?
tf.data: TensorFlow Input Pipeline
Input Pipeline Performance
Software Pipelining
Parallel Transformation
Parallel Extraction
tf.data Options
TFDS: TensorFlow Datasets
Why distributed training?
tf.distribute. Strategy API
How to use tf.distribute.Strategy?
Multi-GPU all-reduce sync training
All-Reduce Algorithm
Synchronous Training
Multi-GPU Performance ResNetso v1.5 Performance with
Multi-worker all-reduce sync training
All-reduce sync training for TPUs
Parameter Servers and Workers
Central Storage
Programming Model
What's supported in TF 2.0 Beta

Taught by

TensorFlow

Reviews

Start your review of Inside TensorFlow - tf.data + tf.distribute

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.