Improving Deep Neural Networks: Hyperparameter tuning, Regularization and Optimization (Coursera)

Offered by DeepLearning.AI,
Improving Deep Neural Networks: Hyperparameter tuning, Regularization and Optimization (Coursera)

This course will teach you the "magic" of getting deep learning to work well. Rather than the deep learning process being a black box, you will understand what drives performance, and be able to more systematically get good results. You will also learn TensorFlow.

Class Deals by MOOC List - Click here and see Coursera's Active Discounts, Deals, and Promo Codes.

After 3 weeks, you will:

  • Understand industry best-practices for building deep learning applications.
  • Be able to effectively use the common neural network "tricks", including initialization, L2 and dropout regularization, Batch normalization, gradient checking,
  • Be able to implement and apply a variety of optimization algorithms, such as mini-batch gradient descent, Momentum, RMSprop and Adam, and check for their convergence.
  • Understand new best-practices for the deep learning era of how to set up train/dev/test sets and analyze bias/variance
  • Be able to implement a neural network in TensorFlow.

Course 2 of 5 in the Deep Learning Specialization.

Syllabus

WEEK 1: Practical aspects of Deep Learning
WEEK 2: Optimization algorithms
WEEK 3: Hyperparameter tuning, Batch Normalization and Programming Frameworks

Go to Class
MOOC List is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Related Courses

Google Cloud Product Fundamentals em Português Brasileiro (Coursera) Coursera
Google Cloud

Google Cloud Product Fundamentals em Português Brasileiro (Coursera)

Este curso é uma continuação do "Business Transformation with Google Cloud" e guiará você pela jornada de transformação de uma organização do ponto de vista tecnológico. Explicaremos como as organizações podem fazer a transformação digital usando a tecnologia do Google Cloud nestas categorias: modernização da infraestrutura de TI; melhorias no processo de desenvolvimento dos aplicativos da empresa; uso do machine learning e da inteligência artificial para criar novo valor; a importância de ferramentas de produtividade como o G Suite na realização do trabalho; e compreender as oportunidades e os desafios da gestão do custo que uma infraestrutura de TI na nuvem traz.

Sep 28th 2026
5-12 Weeks
The Unix Workbench (Coursera) Coursera
Johns Hopkins University

The Unix Workbench (Coursera)

Unix forms a foundation that is often very helpful for accomplishing other goals you might have for you and your computer, whether that goal is running a business, writing a book, curing disease, or creating the next great app. The means to these goals are sometimes carried out by writing software. Software can’t be mined out of the ground, nor can software seeds be planted in spring to harvest by autumn. Software isn’t produced in factories on an assembly line. Software is a hand-made, often bespoke good. If a software developer is an artisan, then Unix is their workbench.

Sep 28th 2026
4 Weeks
Preparing for the Google Cloud Professional Data Engineer Exam em Português Brasileiro (Coursera) Coursera
Google Cloud

Preparing for the Google Cloud Professional Data Engineer Exam em Português Brasileiro (Coursera)

Por que fazer o curso: "A melhor forma de se preparar para o exame é ser competente nas habilidades necessárias ao trabalho." Este curso usa uma abordagem "top-down". Ele identifica as habilidades que você já tem e apresenta novas informações e áreas para ampliar seus conhecimentos. Use este curso para criar seu plano de preparação personalizado. Ele ajudará você a identificar o que sabe e o que precisa estudar mais, além de desenvolver e praticar as habilidades necessárias às competências do cargo.

Sep 28th 2026
1 Week
Probabilistic Graphical Models 3: Learning (Coursera) Coursera
Stanford University

Probabilistic Graphical Models 3: Learning (Coursera)

Probabilistic graphical models (PGMs) are a rich framework for encoding probability distributions over complex domains: joint (multivariate) distributions over large numbers of random variables that interact with each other. These representations sit at the intersection of statistics and computer science, relying on concepts from probability theory, graph algorithms, machine learning, and more. They are the basis for the state-of-the-art methods in a wide variety of applications, such as medical diagnosis, image understanding, speech recognition, natural language processing, and many, many more. They are also a foundational tool in formulating many machine learning problems.

Sep 28th 2026
5-12 Weeks
Approximation Algorithms Part II (Coursera) Coursera
École normale supérieure

Approximation Algorithms Part II (Coursera)

This is the continuation of Approximation algorithms, Part 1. Here you will learn linear programming duality applied to the design of some approximation algorithms, and semidefinite programming applied to Maxcut. By taking the two parts of this course, you will be exposed to a range of problems at the foundations of theoretical computer science, and to powerful design and analysis techniques.

Sep 28th 2026
4 Weeks
Information Extraction from Free Text Data in Health (Coursera) Coursera
University of Michigan

Information Extraction from Free Text Data in Health (Coursera)

In this MOOC, you will be introduced to advanced machine learning and natural language processing techniques to parse and extract information from unstructured text documents in healthcare, such as clinical notes, radiology reports, and discharge summaries. Whether you are an aspiring data scientist or an early or mid-career professional in data science or information technology in healthcare, it is critical that you keep up-to-date your skills in information extraction and analysis.

Sep 28th 2026
4 Weeks
Development of Real-Time Systems (Coursera) Coursera
EIT Digital

Development of Real-Time Systems (Coursera)

This course is intended for the Master's student and computer engineer who likes practical programming and problem solving! After completing this course, you will have the knowledge to plan and set-up a real-time system both on paper and in practice. The course centers around the problem of achieving timing correctness in embedded systems, which means to guarantee that the system reacts within the real-time requirements.

Sep 21st 2026
5-12 Weeks
Decision Making and Reinforcement Learning (Coursera) Coursera
Columbia University

Decision Making and Reinforcement Learning (Coursera)

This course is an introduction to sequential decision making and reinforcement learning. We start with a discussion of utility theory to learn how preferences can be represented and modeled for decision making. We first model simple decision problems as multi-armed bandit problems in and discuss several approaches to evaluate feedback. We will then model decision problems as finite Markov decision processes (MDPs), and discuss their solutions via dynamic programming algorithms. We touch on the notion of partial observability in real problems, modeled by POMDPs and then solved by online planning methods.

Sep 28th 2026
5-12 Weeks
Approximation Algorithms Part I (Coursera) Coursera
École normale supérieure

Approximation Algorithms Part I (Coursera)

How efficiently can you pack objects into a minimum number of boxes? How well can you cluster nodes so as to cheaply separate a network into components around a few centers? These are examples of NP-hard combinatorial optimization problems. It is most likely impossible to solve such problems efficiently, so our aim is to give an approximate solution that can be computed in polynomial time and that at the same time has provable guarantees on its cost relative to the optimum.

Sep 28th 2026
5-12 Weeks
Machine Learning in Healthcare: Fundamentals & Applications (Coursera) Coursera
Northeastern University

Machine Learning in Healthcare: Fundamentals & Applications (Coursera)

Examines data mining perspectives and methods in a healthcare context. Introduces the theoretical foundations for major data mining methods and studies how to select and use the appropriate data mining method and the major advantages for each. Students are exposed to contemporary data mining software applications and basic programming skills. Focuses on solving real-world problems, which require data cleaning, data transformation, and data modeling.

Sep 28th 2026
4 Weeks
Machine Learning and Human Learning (Coursera) Coursera
University of Illinois at Urbana-Champaign

Machine Learning and Human Learning (Coursera)

This course examines the differences between machine and human learning and the ways in which machines can complement human learning. It examines technical definitions of supervised and unsupervised machine learning, as well as broader views of mechanical intelligence able to replicate or exceed human intelligence.

Sep 28th 2026
4 Weeks