Back to Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization
DeepLearning.AI

Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization

In the second course of the Deep Learning Specialization, you will open the deep learning black box to understand the processes that drive performance and generate good results systematically. By the end, you will learn the best practices to train and develop test sets and analyze bias/variance for building deep learning applications; be able to use standard neural network techniques such as initialization, L2 and dropout regularization, hyperparameter tuning, batch normalization, and gradient checking; implement and apply a variety of optimization algorithms, such as mini-batch gradient descent, Momentum, RMSprop and Adam, and check for their convergence; and implement a neural network in TensorFlow. The Deep Learning Specialization is our foundational program that will help you understand the capabilities, challenges, and consequences of deep learning and prepare you to participate in the development of leading-edge AI technology. It provides a pathway for you to gain the knowledge and skills to apply machine learning to your work, level up your technical career, and take the definitive step in the world of AI.

Status: Deep Learning
Status: Machine Learning Methods
IntermediateCourse24 hours

Featured reviews

AS

5.0Reviewed Apr 18, 2020

Very good course to give you deep insight about how to enhance your algorithm and neural network and improve its accuracy. Also teaches you Tensorflow. Highly recommend especially after the 1st course

RR

4.0Reviewed Jun 12, 2020

Could have increased assignments and some more indepth knowledge of tensorflow and proper installation way of tensorflow cause mine is showing error when iam trying to practice as shown in the video

DH

5.0Reviewed Apr 26, 2020

Everything, Everyparameter in neural networks looks familiar to me now. I feel like I can optimize them for better accuracy. Overall I learned some new things and the way of teaching was really nice.

SC

5.0Reviewed Feb 14, 2018

A valuable course in enhancing one's ability to properly identify the correct Hyperparameter to tune according to the situation - a critical task in day-to-day debugging & tuning of an algorithm.

NC

5.0Reviewed Aug 18, 2017

Yet another excellent course by Professor Ng! Really helped me gain a detailed understanding of optimization techniques such as RMSprop and Adam, as well as the inner workings of batch normalization.

NC

5.0Reviewed Jun 2, 2018

Just as great as the previous course. I feel like I have a much better chance at figuring out what to do to improve the performance of a neural network and TensorFlow makes much more sense to me now.

NT

4.0Reviewed Aug 19, 2019

I think this course is great. Because we learn about some definitions about hyperparameters, optimization which are frequently appears in papers or in the functions in some Deep Learning frameworks.

AS

5.0Reviewed Nov 19, 2018

This course is a big part of the meat of the Deep Learning specialization. I found both lectures and exercises gave me valuable practice at grappling with the actual process of training neural nets.

XG

5.0Reviewed Oct 30, 2017

Thank you Andrew!! I know start to use Tensorflow, however, this tool is not well for a research goal. Maybe, pytorch could be considered in the future!! And let us know how to use pytorch in Windows.

AA

4.0Reviewed Oct 22, 2017

Assignment in week 2 could not tell the difference between 'a-=b' and 'a=a-b' and marked the former as incorrect even though they are the same and gave the same output. Other than that, a great course

BA

4.0Reviewed May 31, 2020

Very good course, useful and smart. Some of the example are on tensorflow 1 but I think that they will update them soon to keras tf2 Thank you!I will pass on what I have learned here to undergrads :)

CM

5.0Reviewed Dec 23, 2017

Exceptional Course, the Hyper parameters explanations are excellent every tip and advice provided help me so much to build better models, I also really liked the introduction of Tensor Flow Thanks.

All reviews

Showing: 20 of 7,290

Brennon Bortz
1.0
Reviewed Apr 23, 2018
oli cairns
3.0
Reviewed Dec 9, 2018
Alan Shi
3.0
Reviewed Sep 30, 2017
Lien Chu
3.0
Reviewed Mar 31, 2019
NASIR AHMAD
5.0
Reviewed Jan 14, 2020
Xiao Guo
5.0
Reviewed Oct 31, 2017
Alex Morgand
5.0
Reviewed Oct 9, 2019
Md. Redwan Karim Sony
5.0
Reviewed Apr 15, 2019
Abhishek Sharma
5.0
Reviewed Apr 19, 2020
Carlos V. Montenegro
5.0
Reviewed Dec 24, 2017
Matthew Glass
5.0
Reviewed Apr 17, 2019
Yuhang Wu
3.0
Reviewed Nov 25, 2018
Anand Ramachandran
5.0
Reviewed Feb 17, 2018
Hernan Felipe Diaz
5.0
Reviewed Dec 5, 2019
Glenn Babecki
5.0
Reviewed May 31, 2018
Abiodun Oki
5.0
Reviewed Apr 6, 2018
Youdinghuan Chen
5.0
Reviewed Dec 28, 2017
Alessandro Tarello
5.0
Reviewed Jan 22, 2018
Hassan Shallal
5.0
Reviewed Apr 3, 2018
Joseph Sykes
5.0
Reviewed Apr 5, 2021