Optimize ML Models and Deploy Human-in-the-Loop Pipelines (Coursera)

Offered by DeepLearning.AI, AWS,
Optimize ML Models and Deploy Human-in-the-Loop Pipelines (Coursera)

In the third course of the Practical Data Science Specialization, you will learn a series of performance-improvement and cost-reduction techniques to automatically tune model accuracy, compare prediction performance, and generate new training data with human intelligence. After tuning your text classifier using Amazon SageMaker Hyper-parameter Tuning (HPT), you will deploy two model candidates into an A/B test to compare their real-time prediction performance and automatically scale the winning model using Amazon SageMaker Hosting.

Class Deals by MOOC List - Click here and see Coursera's Active Discounts, Deals, and Promo Codes.

Lastly, you will set up a human-in-the-loop pipeline to fix misclassified predictions and generate new training data using Amazon Augmented AI and Amazon SageMaker Ground Truth.
Practical data science is geared towards handling massive datasets that do not fit in your local hardware and could originate from multiple sources. One of the biggest benefits of developing and running data science projects in the cloud is the agility and elasticity that the cloud offers to scale up and out at a minimum cost.
The Practical Data Science Specialization helps you develop the practical skills to effectively deploy your data science projects and overcome challenges at each step of the ML workflow using Amazon SageMaker. This Specialization is designed for data-focused developers, scientists, and analysts familiar with the Python and SQL programming languages and want to learn how to build, train, and deploy scalable, end-to-end ML pipelines - both automated and human-in-the-loop - in the AWS cloud.

Course 3 of 3 in the Practical Data Science Specialization

Syllabus

WEEK 1
Advanced model training, tuning and evaluation
Train, tune, and evaluate models using data-parallel and model-parallel strategies and automatic model tuning.

WEEK 2
Advanced model deployment and monitoring
Deploy models with A/B testing, monitor model performance, and detect drift from baseline metrics.

WEEK 3
Data labeling and human-in-the-loop pipelines
Label data at scale using private human workforces and build human-in-the-loop pipelines.

Go to Class
MOOC List is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Related Courses

Data Wrangling, Analysis and AB Testing with SQL (Coursera) Coursera
University of California, Davis

Data Wrangling, Analysis and AB Testing with SQL (Coursera)

This course allows you to apply the SQL skills taught in “SQL for Data Science” to four increasingly complex and authentic data science inquiry case studies. We'll learn how to convert timestamps of all types to common formats and perform date/time calculations. We'll select and perform the optimal JOIN for a data science inquiry and clean data within an analysis dataset by deduping, running quality checks, backfilling, and handling nulls.

Jun 29th 2026
4 Weeks
Machine Learning Operations 1 (MLOps1-AWS): Deploying AI & ML Models in Production using Amazon Web Services (AWS) (edX) EdX
Statistics.comX,Statistics.com

Machine Learning Operations 1 (MLOps1-AWS): Deploying AI & ML Models in Production using Amazon Web Services (AWS) (edX)

Most data science projects fail. There are various reasons why, but one of the primary reasons is the challenge of deployment. One piece to the deployment puzzle is understanding how data engineers can effectively work with data scientists to monitor and iterate on model performance, which is why we developed this course: Machine Learning Operations 1 (MLOps1): Deploying AI & ML Models in Production using Amazon Web Services (AWS).

Self Paced
Self-Paced
Understanding Data Science (DataCamp) DataCamp
DataCamp

Understanding Data Science (DataCamp)

An introduction to data science with no coding involved. What is data science, why is it so popular, and why did the Harvard Business Review hail it as the “sexiest job of the 21st century”? In this non-technical course, you’ll be introduced to everything you were ever too afraid to ask about this fast-growing and exciting field, without needing to write a single line of code.

Self Paced
Self-Paced
Build, Train, and Deploy ML Pipelines using BERT (Coursera) Coursera
DeepLearning.AI,AWS

Build, Train, and Deploy ML Pipelines using BERT (Coursera)

In the second course of the Practical Data Science Specialization, you will learn to automate a natural language processing task by building an end-to-end machine learning pipeline using Hugging Face’s highly-optimized implementation of the state-of-the-art BERT algorithm with Amazon SageMaker Pipelines. Your pipeline will first transform the dataset into BERT-readable features and store the features in the Amazon SageMaker Feature Store. It will then fine-tune a text classification model to the dataset using a Hugging Face pre-trained model, which has learned to understand the human language from millions of Wikipedia documents.

Mar 25th 2024
3 Weeks
Machine Learning Operations 1 (MLOps1-GCP): Deploying AI & ML Models in Production using Google Cloud Platform (GCP) (edX) EdX
Statistics.comX,Statistics.com

Machine Learning Operations 1 (MLOps1-GCP): Deploying AI & ML Models in Production using Google Cloud Platform (GCP) (edX)

Most data science projects fail. There are various reasons why, but one of the primary reasons is the challenge of deployment. One piece to the deployment puzzle is understanding how data engineers can effectively work with data scientists to monitor and iterate on model performance, which is why we developed this course: Machine Learning Operations 1 (MLOps1) - Deploying AI & ML Models in Production using Google Cloud Platform (GCP).

Self Paced
Self-Paced
Business Analytics Using Forecasting (FutureLearn) FutureLearn
National Tsing Hua University

Business Analytics Using Forecasting (FutureLearn)

Discover how business can harness the power of big data to make better predictive analysis. Learn how to use data to create powerful business forecasts. Organisations currently collect a vast quantity of data about suppliers, clients, employees, citizens, transactions, and much more. However, many are unaware of the predictive power this ‘big data’ has if anaylsed correctly. On this course, you’ll learn about forecasting using big data, exploring how it’s used by business as an important component of decision making.

Self Paced
5-12 Weeks
Managing Machine Learning Projects with Google Cloud (Coursera) Coursera
Google Cloud

Managing Machine Learning Projects with Google Cloud (Coursera)

Business professionals in non-technical roles have a unique opportunity to lead or influence machine learning projects. If you have questions about machine learning and want to understand how to use it, without the technical jargon, this course is for you. Learn how to translate business problems into machine learning use cases and vet them for feasibility and impact.

Jul 6th 2026
4 Weeks
Measure and Optimize Social Media Marketing Campaigns (Coursera) Coursera
Facebook

Measure and Optimize Social Media Marketing Campaigns (Coursera)

This course provides you with the skills to optimize your social media marketing efforts. Learn to evaluate and interpret the results of your advertising campaigns. Learn how to assess advertising effectiveness through lift studies and optimize your campaigns with split testing. Understand how advertising effectiveness is measured across platforms and devices, learn how to evaluate the ROI of your marketing, and master how to communicate your social media marketing results to others in the company. By the end of this course, you will be able to: analyze dashboards and evaluate ROI from your social media marketing efforts; understand different techniques used to optimize marketing campaigns, such as attribution and marketing mix models; implement an A/B test to optimize your campaign; present and communicate the results of your campaign to a team.

Sep 20th 2026
4 Weeks
Introduction to Machine Learning in Production (Coursera) Coursera
DeepLearning.AI

Introduction to Machine Learning in Production (Coursera)

In the first course of Machine Learning Engineering for Production Specialization, you will identify the various components and design an ML production system end-to-end: project scoping, data needs, modeling strategies, and deployment constraints and requirements; and learn how to establish a model baseline, address concept drift, and prototype the process for developing, deploying, and continuously improving a productionized ML application.

Jul 6th 2026
3 Weeks