Optimize ML Models and Deploy Human-in-the-Loop Pipelines (Coursera)

Offered by DeepLearning.AI, AWS,
Optimize ML Models and Deploy Human-in-the-Loop Pipelines (Coursera)

In the third course of the Practical Data Science Specialization, you will learn a series of performance-improvement and cost-reduction techniques to automatically tune model accuracy, compare prediction performance, and generate new training data with human intelligence. After tuning your text classifier using Amazon SageMaker Hyper-parameter Tuning (HPT), you will deploy two model candidates into an A/B test to compare their real-time prediction performance and automatically scale the winning model using Amazon SageMaker Hosting.

Class Deals by MOOC List - Click here and see Coursera's Active Discounts, Deals, and Promo Codes.

Lastly, you will set up a human-in-the-loop pipeline to fix misclassified predictions and generate new training data using Amazon Augmented AI and Amazon SageMaker Ground Truth.
Practical data science is geared towards handling massive datasets that do not fit in your local hardware and could originate from multiple sources. One of the biggest benefits of developing and running data science projects in the cloud is the agility and elasticity that the cloud offers to scale up and out at a minimum cost.
The Practical Data Science Specialization helps you develop the practical skills to effectively deploy your data science projects and overcome challenges at each step of the ML workflow using Amazon SageMaker. This Specialization is designed for data-focused developers, scientists, and analysts familiar with the Python and SQL programming languages and want to learn how to build, train, and deploy scalable, end-to-end ML pipelines - both automated and human-in-the-loop - in the AWS cloud.

Course 3 of 3 in the Practical Data Science Specialization

Syllabus

WEEK 1
Advanced model training, tuning and evaluation
Train, tune, and evaluate models using data-parallel and model-parallel strategies and automatic model tuning.

WEEK 2
Advanced model deployment and monitoring
Deploy models with A/B testing, monitor model performance, and detect drift from baseline metrics.

WEEK 3
Data labeling and human-in-the-loop pipelines
Label data at scale using private human workforces and build human-in-the-loop pipelines.

Go to Class
MOOC List is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Related Courses

Business Applications of Hypothesis Testing and Confidence Interval Estimation (Coursera) Coursera
Rice University

Business Applications of Hypothesis Testing and Confidence Interval Estimation (Coursera)

Confidence intervals and Hypothesis tests are very important tools in the Business Statistics toolbox. A mastery over these topics will help enhance your business decision making and allow you to understand and measure the extent of ‘risk’ or ‘uncertainty’ in various business processes. This course advances your knowledge about Business Statistics by introducing you to Confidence Intervals and Hypothesis Testing. These are done by easy to understand applications.

Aug 10th 2026
4 Weeks
Machine Learning Operations 1 (MLOps1-AML): Deploying AI & ML Models in Production using Microsoft Azure Machine Learning (AML) (edX) EdX
Statistics.comX,Statistics.com

Machine Learning Operations 1 (MLOps1-AML): Deploying AI & ML Models in Production using Microsoft Azure Machine Learning (AML) (edX)

Most data science projects fail. There are various reasons why, but one of the primary reasons is the challenge of deployment. One piece to the deployment puzzle is understanding how data engineers can effectively work with data scientists to monitor and iterate on model performance, which is why we developed this course: Machine Learning Ops (MLOps1) - Deploying AI & ML Models in Production using Microsoft Azure Machine Learning (AML).

Self Paced
Self-Paced
UX Evaluation: User Testing (edX) EdX
HECMontrealX,HEC Montréal

UX Evaluation: User Testing (edX)

Master UX evaluation using a variety of skill sets and methods. Uncover the knowledge of user testing from a guerrilla approach to formal lab evaluations required for compliance tests. Testing! 1-2, 1-2! You’re interested in user experience and you have a scientific way of thinking? UX needs you! User testing is an empirical practice. This expertise is the most widespread and sought-after of the UX fields.

Self Paced
Self-Paced
Understanding Data Science (DataCamp) DataCamp
DataCamp

Understanding Data Science (DataCamp)

An introduction to data science with no coding involved. What is data science, why is it so popular, and why did the Harvard Business Review hail it as the “sexiest job of the 21st century”? In this non-technical course, you’ll be introduced to everything you were ever too afraid to ask about this fast-growing and exciting field, without needing to write a single line of code.

Self Paced
Self-Paced
Business Analytics Using Forecasting (FutureLearn) FutureLearn
National Tsing Hua University

Business Analytics Using Forecasting (FutureLearn)

Discover how business can harness the power of big data to make better predictive analysis. Learn how to use data to create powerful business forecasts. Organisations currently collect a vast quantity of data about suppliers, clients, employees, citizens, transactions, and much more. However, many are unaware of the predictive power this ‘big data’ has if anaylsed correctly. On this course, you’ll learn about forecasting using big data, exploring how it’s used by business as an important component of decision making.

Self Paced
5-12 Weeks
The Business of Social (Coursera) Coursera
Northwestern University

The Business of Social (Coursera)

In a 2014 study of CEOs and CMOs, IBM found 63% wanted social strategies which generate business metrics while only 20% of businesses worldwide actually have them. This means strategies which not only grow your company’s social footprint but link to your sales and marketing systems. With this critical linkage, your social and mobile strategies will provide you with the ability to engage consumers at a 1-to-1 level and measure your social investments in terms of costs, revenues, profits and ROI. In this fifth MOOC of the Social Marketing Specialization - "The Business of Social" - you will learn how to transform your organization's social marketing from an untracked investment to an integral part of your company’s marketing strategy.

Jul 20th 2026
4 Weeks