Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization
deeplearning.ai and Stanford University via Coursera
Social Learning for Open Courses
Join one of our cohorts to learn from instructors, experts, or each other with weekly live streams.
-
Coursera
Uncommon Sense TeachingA Cohort with the acclaimed Instructor Barbara Oakley with 4+ million learners worldwide. This course weaves late-breaking insights from neuroscience with practical new approaches from the classroom.
Jan 17, 2022653 enrolled
-
University of California, San Diego
Aprendiendo a AprenderEn esta Cohorte de 4 semanas, descubrirás invaluables técnicas de aprendizaje basadas en la neurociencia presentadas en el aclamado curso “Aprendiendo a Aprender” (Learning How to Learn) por Orlando Trejo, instructor del curso en Español.
Jan 24, 2022260 enrolled
Overview
Class Central Tips
By the end, you will learn the best practices to train and develop test sets and analyze bias/variance for building deep learning applications; be able to use standard neural network techniques such as initialization, L2 and dropout regularization, hyperparameter tuning, batch normalization, and gradient checking; implement and apply a variety of optimization algorithms, such as mini-batch gradient descent, Momentum, RMSprop and Adam, and check for their convergence; and implement a neural network in TensorFlow.
The Deep Learning Specialization is our foundational program that will help you understand the capabilities, challenges, and consequences of deep learning and prepare you to participate in the development of leading-edge AI technology. It provides a pathway for you to gain the knowledge and skills to apply machine learning to your work, level up your technical career, and take the definitive step in the world of AI.
Syllabus
- Practical Aspects of Deep Learning
- Discover and experiment with a variety of different initialization methods, apply L2 regularization and dropout to avoid model overfitting, then apply gradient checking to identify errors in a fraud detection model.
- Optimization Algorithms
- Develop your deep learning toolbox by adding more advanced optimizations, random minibatching, and learning rate decay scheduling to speed up your models.
- Hyperparameter Tuning, Batch Normalization and Programming Frameworks
- Explore TensorFlow, a deep learning framework that allows you to build neural networks quickly and easily, then train a neural network on a TensorFlow dataset.
Taught by
Andrew Ng
Charts
- #2 in Subjects / Machine Learning / TensorFlow
Related Courses
Related articles
Reviews
5.0 rating, based on 3 reviews
-
Nattapon Sub-Anake
1Nattapon Sub-Anake completed this course, spending 6 hours a week on it and found the course difficulty to be medium.
I finished this second deep learning course and I like it very much. I am looking forward for more courses in this deep learning series. Andrew is doing a great job here. -
Silveira Homero3
Silveira Homero completed this course, spending 9 hours a week on it and found the course difficulty to be medium.
This is a follow up course to Neural Networks and Deep Learning so you must start with the latter. The practical side of the teaching was very interesting. -
Raivis Joksts
23Raivis Joksts completed this course, spending 6 hours a week on it and found the course difficulty to be easy.
A good look at most important parameters that impact DL models. Again it is math heavy, but it' s ok to just understand basic logic behind it. Has some TensorFlow practical tasks, which are easy to complete, but you may wish to read up on TF on your own to understand how it works in general, especially if you have used other DLK framework before - like PyTorch, for example.
Never Stop Learning!
