Operationalizing LLMs on Azure (Coursera)

Offered by Duke University,
Operationalizing LLMs on Azure (Coursera)

This course is designed for individuals at both an intermediate and beginner level, including data scientists, AI enthusiasts, and professionals seeking to harness the power of Azure for Large Language Models (LLMs). Tailored for those with foundational programming experience and familiarity with Azure basics, this comprehensive program takes you through a four-week journey.

Class Deals by MOOC List - Click here and see Coursera's Active Discounts, Deals, and Promo Codes.

In the first week, you'll delve into Azure's AI services and the Azure portal, gaining insights into large language models, their functionalities, and strategies for risk mitigation. Subsequent weeks cover practical applications, including leveraging Azure Machine Learning, managing GPU quotas, deploying models, and utilizing the Azure OpenAI Service. As you progress, the course explores nuanced query crafting, Semantic Kernel implementation, and advanced strategies for optimizing interactions with LLMs within the Azure environment. The final week focuses on architectural patterns, deployment strategies, and hands-on application building using RAG, Azure services, and GitHub Actions workflows. Whether you're a data professional or AI enthusiast, this course equips you with the skills to deploy, optimize, and build robust large-scale applications leveraging Azure and Large Language Models.
This course is part of the Large Language Model Operations (LLMOps) Specialization.

What you'll learn

  • Gain proficiency in leveraging Azure for deploying and managing Large Language Models (LLMs).
  • Develop advanced query crafting skills using Semantic Kernel to optimize interactions with LLMs within the Azure environment.
  • Acquire hands-on experience in implementing patterns and deploying applications with Retrieval Augmented Generation (RAG)

Syllabus

Introduction to LLMOps with Azure
This week, you will learn how to get started with Azure and its AI services through an introduction to the Azure portal, and key offerings like Azure Machine Learning. You will also gain an understanding of large language models, including how they work, their benefits and risks, and strategies for mitigating those risks. Finally, you will be introduced to options for discovering, evaluating, and deploying pre-trained LLMs in Azure, including leveraging prompt engineering for responsible data grounding.

LLMs with Azure
This week, you will learn to leverage Azure for Large Language Models (LLMs) by using Azure Machine Learning through its compute resources and managing GPU quotas and model deployments as well as Azure OpenAI Service. You will apply this knowledge by deploying a model and using its inference API using the Python programming language.

Extending with Functions and Plugins
This week, you will discover the art of crafting nuanced queries for Large Language Models (LLMs) in Azure through the implementation of Semantic Kernel. You will gain insights into refining prompts, understand the dynamics of using system prompts, and explore advanced strategies to optimize your interaction with LLMs. You will apply these techniques hands-on to enhance your proficiency in leveraging Semantic Kernel within the Azure environment.

Building an End-to-End LLM application in Azure
This week, you will explore architectural patterns and deployment of large language model applications. By studying RAG, Azure services, and GitHub Actions, you will learn how to build robust applications. You will apply your learning by implementing RAG with Azure search, creating GitHub Actions workflows, and deploying an end-to-end application.

Go to Class
MOOC List is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Related Courses

Exam Prep DP-300: Azure Database Administrator Associate (Coursera) Coursera
Whizlabs

Exam Prep DP-300: Azure Database Administrator Associate (Coursera)

Database administration is one of the basic necessities of every enterprise. The growth of cloud and On-premises relational databases continues to create the need for professional database administrators. Therefore, an updated certification such as DP-300 could open up favorable options for employment of database administrators.

Nov 9th 2026
5-12 Weeks
Prompt Engineering for Web Developers (Coursera) Coursera
Scrimba

Prompt Engineering for Web Developers (Coursera)

Not quite getting the results you want from ChatGPT? Wondering how you can use AI language models to your advantage? Then this course is for you! If you’ve spent any amount of time with AI language models like ChatGPT and Google Bard, you may have noticed the results can sometimes be, well, frustrating. When it comes to leveraging AI language models, your output is often only as good as your input. In other words, it’s all about learning how best to communicate your desired results. Effective prompt engineering is the secret sauce for getting the most out of AI.

Nov 9th 2026
3 Weeks
GitHub Copilot: The AI Pair Programmer for Coding (Coursera) Coursera
Edureka

GitHub Copilot: The AI Pair Programmer for Coding (Coursera)

Welcome to the 'GitHub Copilot: The AI Pair Programmer for Coding' course, where you will embark on an insightful journey to develop a profound understanding of the AI principles that power GitHub Copilot's coding assistance. This course is designed to transform your coding practices, leveraging the advanced capabilities of GitHub Copilot.

Nov 9th 2026
1 Week
Inteligência Artificial para Logística (Coursera) Coursera
FIA Business School

Inteligência Artificial para Logística (Coursera)

Nossas boas-vindas ao Curso Inteligência Artificial para Logística. Neste curso, você aprenderá sobre os processos de planejamento logístico, seu escopo de atuação e sua integração com as demais áreas da empresa, e como as novas tecnologias de inteligência artificial e internet das coisas podem ampliar a eficiência e a geração de valor para a empresa.

Nov 9th 2026
4 Weeks
Infrastructure Automation with Terraform (Coursera) Coursera
Whizlabs

Infrastructure Automation with Terraform (Coursera)

Terraform is one of the most recognized infrastructure automation tools that help in addressing various real-life challenges. Infrastructure automation is a reliable instrument for improving productivity, efficiency, and reduction of operational downtime for enterprises. As a result, you can gain better career opportunities with skills in infrastructure automation with Terraform.

Nov 9th 2026
5-12 Weeks
GenAI for Everyone (Coursera) Coursera
Coursera Instructor Network

GenAI for Everyone (Coursera)

This course offers a foundational journey into the world of Generative AI (GenAI), setting the stage for a comprehensive learning path that delves into the nuanced, role-specific applications of AI. Designed to equip learners with essential GenAI knowledge, this primer is the perfect starting point before progressing through a series of courses tailored to various job functions and roles.

Nov 9th 2026
1 Week
Data Augmented Technology Assisted Medical Decision Making (Coursera) Coursera
University of Michigan

Data Augmented Technology Assisted Medical Decision Making (Coursera)

Artificial intelligence (AI) and machine learning (ML) have the potential to increase diagnostic accuracy, decrease diagnostic errors, and improve patient outcomes. The Data Augmented, Technology Assisted Medical Decision Making (DATA-MD) course will teach you how to use AI to augment your diagnostic decision-making.

Nov 9th 2026
4 Weeks
Machine Learning Introduction for Everyone (Coursera) Coursera
IBM

Machine Learning Introduction for Everyone (Coursera)

This three-module course introduces machine learning and data science for everyone with a foundational understanding of machine learning models. You’ll learn about the history of machine learning, applications of machine learning, the machine learning model lifecycle, and tools for machine learning. You’ll also learn about supervised versus unsupervised learning, classification, regression, evaluating machine learning models, and more.

Nov 9th 2026
3 Weeks
Azure Infrastructure Fundamentals (Coursera) Coursera
LearnQuest

Azure Infrastructure Fundamentals (Coursera)

Microsoft Azure is a service created by Microsoft to provide cloud computing for creating and managing applications and services using a cloud environment. Azure provides software as a service (SaaS), platform as a service (PaaS) and infrastructure as a service (IaaS). The platform supports many programming languages and frameworks and can be used alone or in a multi-vendor cloud environment.

Nov 9th 2026
5-12 Weeks