Improving Deep Neural Networks: Hyperparameter tuning, Regularization and Optimization (Coursera)

Offered by DeepLearning.AI,
Improving Deep Neural Networks: Hyperparameter tuning, Regularization and Optimization (Coursera)

This course will teach you the "magic" of getting deep learning to work well. Rather than the deep learning process being a black box, you will understand what drives performance, and be able to more systematically get good results. You will also learn TensorFlow.

Class Deals by MOOC List - Click here and see Coursera's Active Discounts, Deals, and Promo Codes.

After 3 weeks, you will:

  • Understand industry best-practices for building deep learning applications.
  • Be able to effectively use the common neural network "tricks", including initialization, L2 and dropout regularization, Batch normalization, gradient checking,
  • Be able to implement and apply a variety of optimization algorithms, such as mini-batch gradient descent, Momentum, RMSprop and Adam, and check for their convergence.
  • Understand new best-practices for the deep learning era of how to set up train/dev/test sets and analyze bias/variance
  • Be able to implement a neural network in TensorFlow.

Course 2 of 5 in the Deep Learning Specialization.

Syllabus

WEEK 1: Practical aspects of Deep Learning
WEEK 2: Optimization algorithms
WEEK 3: Hyperparameter tuning, Batch Normalization and Programming Frameworks

Go to Class
MOOC List is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Related Courses

Information Theory (Coursera) Coursera
The Chinese University of Hong Kong

Information Theory (Coursera)

At the completion of this course, the student should be able to: demonstrate knowledge and understanding of the fundamentals of information theory; appreciate the notion of fundamental limits in communication systems and more generally all systems; develop deeper understanding of communication systems; apply the concepts of information theory to various disciplines in information science.

Aug 10th 2026
13-24 Weeks
Big Data Analysis with Scala and Spark (Coursera) Coursera
École Polytechnique Fédérale de Lausanne

Big Data Analysis with Scala and Spark (Coursera)

Manipulating big data distributed over a cluster using functional concepts is rampant in industry, and is arguably one of the first widespread industrial uses of functional ideas. This is evidenced by the popularity of MapReduce and Hadoop, and most recently Apache Spark, a fast, in-memory distributed collections framework written in Scala. In this course, we'll see how the data parallel paradigm can be extended to the distributed case, using Spark throughout.

Aug 17th 2026
4 Weeks
Remote Sensing Image Acquisition, Analysis and Applications (Coursera) Coursera
UNSW Sydney - University of New South Wales

Remote Sensing Image Acquisition, Analysis and Applications (Coursera)

Welcome to Remote Sensing Image Acquisition, Analysis and Applications, in which we explore the nature of imaging the earth's surface from space or from airborne vehicles. This course covers the fundamental nature of remote sensing and the platforms and sensor types used. It also provides an in-depth treatment of the computational algorithms employed in image understanding, ranging from the earliest historically important techniques to more recent approaches based on deep learning.

Aug 17th 2026
13-24 Weeks
Algorithms, Part II (Coursera) Coursera
Princeton University

Algorithms, Part II (Coursera)

This course covers the essential information that every serious programmer needs to know about algorithms and data structures, with emphasis on applications and scientific performance analysis of Java implementations. Part I covers elementary data structures, sorting, and searching algorithms. Part II focuses on graph- and string-processing algorithms.

Aug 17th 2026
5-12 Weeks
MOST from a Methodological Perspective (Coursera) Coursera
New York University

MOST from a Methodological Perspective (Coursera)

This course is aimed at intervention scientists working in any area--including public health, education, criminal justice, and others—interested in learning about an innovative framework for conducting intervention research. This course will show you how to use the multiphase optimization strategy (MOST) to: streamline interventions by eliminating inactive components; identify the combination of components that offers the greatest effectiveness without exceeding a defined implementation budget; develop interventions for immediate scalability; look inside the “black box” to understand which intervention components work and which do not; and improve interventions programmatically over time.

Aug 17th 2026
5-12 Weeks
Probabilistic Graphical Models 2: Inference (Coursera) Coursera
Stanford University

Probabilistic Graphical Models 2: Inference (Coursera)

Probabilistic graphical models (PGMs) are a rich framework for encoding probability distributions over complex domains: joint (multivariate) distributions over large numbers of random variables that interact with each other. These representations sit at the intersection of statistics and computer science, relying on concepts from probability theory, graph algorithms, machine learning, and more.

Aug 17th 2026
5-12 Weeks
Introduction to Embedded Machine Learning (Coursera) Coursera
Edge Impulse

Introduction to Embedded Machine Learning (Coursera)

Machine learning allows us to teach computers to make predictions and decisions based on data and learn from experiences. In recent years, incredible optimizations have been made to machine learning algorithms, software frameworks, and embedded hardware. Thanks to this, running deep neural networks and other complex machine learning algorithms is possible on low-power devices like microcontrollers. This course will give you a broad overview of how machine learning works, how to train neural networks, and how to deploy those networks to microcontrollers.

Aug 16th 2026
3 Weeks
Data Augmented Technology Assisted Medical Decision Making (Coursera) Coursera
University of Michigan

Data Augmented Technology Assisted Medical Decision Making (Coursera)

Artificial intelligence (AI) and machine learning (ML) have the potential to increase diagnostic accuracy, decrease diagnostic errors, and improve patient outcomes. The Data Augmented, Technology Assisted Medical Decision Making (DATA-MD) course will teach you how to use AI to augment your diagnostic decision-making.

Aug 17th 2026
4 Weeks
Practical Machine Learning on H2O (Coursera) Coursera
H2O.ai

Practical Machine Learning on H2O (Coursera)

In this course, we will learn all the core techniques needed to make effective use of H2O. Even if you have no prior experience of machine learning, even if your math is weak, by the end of this course you will be able to make machine learning models using a variety of algorithms. We will be using linear models, random forest, GBMs and of course deep learning, as well as some unsupervised learning algorithms.

Aug 17th 2026
5-12 Weeks
Encoder-Decoder Architecture (Coursera) Coursera
Google Cloud

Encoder-Decoder Architecture (Coursera)

This course gives you a synopsis of the encoder-decoder architecture, which is a powerful and prevalent machine learning architecture for sequence-to-sequence tasks such as machine translation, text summarization, and question answering. You learn about the main components of the encoder-decoder architecture and how to train and serve these models. In the corresponding lab walkthrough, you’ll code in TensorFlow a simple implementation of the encoder-decoder architecture for poetry generation from the beginning.

Aug 17th 2026
1 Week