Optimize ML Models and Deploy Human-in-the-Loop Pipelines (Coursera)

Offered by DeepLearning.AI, AWS,
Optimize ML Models and Deploy Human-in-the-Loop Pipelines (Coursera)

In the third course of the Practical Data Science Specialization, you will learn a series of performance-improvement and cost-reduction techniques to automatically tune model accuracy, compare prediction performance, and generate new training data with human intelligence. After tuning your text classifier using Amazon SageMaker Hyper-parameter Tuning (HPT), you will deploy two model candidates into an A/B test to compare their real-time prediction performance and automatically scale the winning model using Amazon SageMaker Hosting.

Class Deals by MOOC List - Click here and see Coursera's Active Discounts, Deals, and Promo Codes.

Lastly, you will set up a human-in-the-loop pipeline to fix misclassified predictions and generate new training data using Amazon Augmented AI and Amazon SageMaker Ground Truth.
Practical data science is geared towards handling massive datasets that do not fit in your local hardware and could originate from multiple sources. One of the biggest benefits of developing and running data science projects in the cloud is the agility and elasticity that the cloud offers to scale up and out at a minimum cost.
The Practical Data Science Specialization helps you develop the practical skills to effectively deploy your data science projects and overcome challenges at each step of the ML workflow using Amazon SageMaker. This Specialization is designed for data-focused developers, scientists, and analysts familiar with the Python and SQL programming languages and want to learn how to build, train, and deploy scalable, end-to-end ML pipelines - both automated and human-in-the-loop - in the AWS cloud.

Course 3 of 3 in the Practical Data Science Specialization

Syllabus

WEEK 1
Advanced model training, tuning and evaluation
Train, tune, and evaluate models using data-parallel and model-parallel strategies and automatic model tuning.

WEEK 2
Advanced model deployment and monitoring
Deploy models with A/B testing, monitor model performance, and detect drift from baseline metrics.

WEEK 3
Data labeling and human-in-the-loop pipelines
Label data at scale using private human workforces and build human-in-the-loop pipelines.

Go to Class
MOOC List is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Related Courses

Optimización de Redes Neuronales Profundas (Coursera) Coursera
Universidad Austral

Optimización de Redes Neuronales Profundas (Coursera)

Este curso se centrará en la optimización de Redes Neuronales Profundas, cambiando la idea de que todo el proceso es una “caja negra”. Comprenderá qué impulsa el rendimiento y podrá obtener mejores resultados de manera más sistemática. Entenderá cómo optimizar los principales Hiperparámetros y su implementación. Además, aprenderá nuevos conceptos útiles para el entrenamiento de las redes como los mini-batch y las regularizaciones. También, aprenderá a implementar una red neuronal utilizando TensorFlow

Oct 26th 2026
3 Weeks
Design Principles: an Introduction (Coursera) Coursera
University of California, San Diego

Design Principles: an Introduction (Coursera)

What makes an interface intuitive? How can I tell whether one design works better than another? This course will teach you fundamental principles of design and how to effectively evaluate your work with users. You'll learn fundamental principles of visual design so that you can effectively organize and present information with your interfaces. You'll learn principles of perception and cognition that inform effective interaction design. And you'll learn how to perform and analyze controlled experiments online. In many cases, we'll use Web design as the anchoring domain.

Nov 16th 2026
3 Weeks
Business Analytics Using Forecasting (FutureLearn) FutureLearn
National Tsing Hua University

Business Analytics Using Forecasting (FutureLearn)

Discover how business can harness the power of big data to make better predictive analysis. Learn how to use data to create powerful business forecasts. Organisations currently collect a vast quantity of data about suppliers, clients, employees, citizens, transactions, and much more. However, many are unaware of the predictive power this ‘big data’ has if anaylsed correctly. On this course, you’ll learn about forecasting using big data, exploring how it’s used by business as an important component of decision making.

Self Paced
5-12 Weeks
UX Evaluation: User Testing (edX) EdX
HECMontrealX,HEC Montréal

UX Evaluation: User Testing (edX)

Master UX evaluation using a variety of skill sets and methods. Uncover the knowledge of user testing from a guerrilla approach to formal lab evaluations required for compliance tests. Testing! 1-2, 1-2! You’re interested in user experience and you have a scientific way of thinking? UX needs you! User testing is an empirical practice. This expertise is the most widespread and sought-after of the UX fields.

Self Paced
Self-Paced
Machine Learning Operations 1 (MLOps1-AWS): Deploying AI & ML Models in Production using Amazon Web Services (AWS) (edX) EdX
Statistics.comX,Statistics.com

Machine Learning Operations 1 (MLOps1-AWS): Deploying AI & ML Models in Production using Amazon Web Services (AWS) (edX)

Most data science projects fail. There are various reasons why, but one of the primary reasons is the challenge of deployment. One piece to the deployment puzzle is understanding how data engineers can effectively work with data scientists to monitor and iterate on model performance, which is why we developed this course: Machine Learning Operations 1 (MLOps1): Deploying AI & ML Models in Production using Amazon Web Services (AWS).

Self Paced
Self-Paced
Understanding Data Science (DataCamp) DataCamp
DataCamp

Understanding Data Science (DataCamp)

An introduction to data science with no coding involved. What is data science, why is it so popular, and why did the Harvard Business Review hail it as the “sexiest job of the 21st century”? In this non-technical course, you’ll be introduced to everything you were ever too afraid to ask about this fast-growing and exciting field, without needing to write a single line of code.

Self Paced
Self-Paced
Managing Machine Learning Projects with Google Cloud (Coursera) Coursera
Google Cloud

Managing Machine Learning Projects with Google Cloud (Coursera)

Business professionals in non-technical roles have a unique opportunity to lead or influence machine learning projects. If you have questions about machine learning and want to understand how to use it, without the technical jargon, this course is for you. Learn how to translate business problems into machine learning use cases and vet them for feasibility and impact.

Jul 6th 2026
4 Weeks
Estimating ML-Models Financial Impact (Coursera) Coursera
Higher School of Economics - HSE University

Estimating ML-Models Financial Impact (Coursera)

This course covers the basics of financial impact estimation for machine learning models deployed in business processes. We will discuss the general approaches to financial estimation, consider the applications to credit scoring and marketing response models, and focus on the relationship between statistical model quality metrics and financial results, as well as the concepts of A/B testing and potential biases as they apply to historical data. Multiple courses focus on building machine learning models and assessing their predictive power. However, much less attention is usually paid to explaining how the model quality translates into financial results.

Jul 18th 2022
5-12 Weeks
Data Wrangling, Analysis and AB Testing with SQL (Coursera) Coursera
University of California, Davis

Data Wrangling, Analysis and AB Testing with SQL (Coursera)

This course allows you to apply the SQL skills taught in “SQL for Data Science” to four increasingly complex and authentic data science inquiry case studies. We'll learn how to convert timestamps of all types to common formats and perform date/time calculations. We'll select and perform the optimal JOIN for a data science inquiry and clean data within an analysis dataset by deduping, running quality checks, backfilling, and handling nulls.

Jun 29th 2026
4 Weeks
Process Mining: Data science in Action (Coursera) Coursera
Eindhoven University of Technology

Process Mining: Data science in Action (Coursera)

Process mining is the missing link between model-based process analysis and data-oriented analysis techniques. Through concrete data sets and easy to use software the course provides data science knowledge that can be applied directly to analyze and improve processes in a variety of domains. Data science is the profession of the future, because organizations that are unable to use (big) data in a smart way will not survive. It is not sufficient to focus on data storage and data analysis. The data scientist also needs to relate data to process analysis.

Nov 16th 2026
5-12 Weeks