Operationalizing LLMs on Azure (Coursera)

Offered by Duke University,
Operationalizing LLMs on Azure (Coursera)

This course is designed for individuals at both an intermediate and beginner level, including data scientists, AI enthusiasts, and professionals seeking to harness the power of Azure for Large Language Models (LLMs). Tailored for those with foundational programming experience and familiarity with Azure basics, this comprehensive program takes you through a four-week journey.

Class Deals by MOOC List - Click here and see Coursera's Active Discounts, Deals, and Promo Codes.

In the first week, you'll delve into Azure's AI services and the Azure portal, gaining insights into large language models, their functionalities, and strategies for risk mitigation. Subsequent weeks cover practical applications, including leveraging Azure Machine Learning, managing GPU quotas, deploying models, and utilizing the Azure OpenAI Service. As you progress, the course explores nuanced query crafting, Semantic Kernel implementation, and advanced strategies for optimizing interactions with LLMs within the Azure environment. The final week focuses on architectural patterns, deployment strategies, and hands-on application building using RAG, Azure services, and GitHub Actions workflows. Whether you're a data professional or AI enthusiast, this course equips you with the skills to deploy, optimize, and build robust large-scale applications leveraging Azure and Large Language Models.
This course is part of the Large Language Model Operations (LLMOps) Specialization.

What you'll learn

  • Gain proficiency in leveraging Azure for deploying and managing Large Language Models (LLMs).
  • Develop advanced query crafting skills using Semantic Kernel to optimize interactions with LLMs within the Azure environment.
  • Acquire hands-on experience in implementing patterns and deploying applications with Retrieval Augmented Generation (RAG)

Syllabus

Introduction to LLMOps with Azure
This week, you will learn how to get started with Azure and its AI services through an introduction to the Azure portal, and key offerings like Azure Machine Learning. You will also gain an understanding of large language models, including how they work, their benefits and risks, and strategies for mitigating those risks. Finally, you will be introduced to options for discovering, evaluating, and deploying pre-trained LLMs in Azure, including leveraging prompt engineering for responsible data grounding.

LLMs with Azure
This week, you will learn to leverage Azure for Large Language Models (LLMs) by using Azure Machine Learning through its compute resources and managing GPU quotas and model deployments as well as Azure OpenAI Service. You will apply this knowledge by deploying a model and using its inference API using the Python programming language.

Extending with Functions and Plugins
This week, you will discover the art of crafting nuanced queries for Large Language Models (LLMs) in Azure through the implementation of Semantic Kernel. You will gain insights into refining prompts, understand the dynamics of using system prompts, and explore advanced strategies to optimize your interaction with LLMs. You will apply these techniques hands-on to enhance your proficiency in leveraging Semantic Kernel within the Azure environment.

Building an End-to-End LLM application in Azure
This week, you will explore architectural patterns and deployment of large language model applications. By studying RAG, Azure services, and GitHub Actions, you will learn how to build robust applications. You will apply your learning by implementing RAG with Azure search, creating GitHub Actions workflows, and deploying an end-to-end application.

Go to Class
MOOC List is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Related Courses

Introduction to Generative AI Studio (Coursera) Coursera
Google Cloud

Introduction to Generative AI Studio (Coursera)

This course introduces Generative AI Studio, a product on Vertex AI, that helps you prototype and customize generative AI models so you can use their capabilities in your applications. In this course, you learn what Generative AI Studio is, its features and options, and how to use it by walking through demos of the product. In the end, you will have a quiz to test your knowledge.

Aug 3rd 2026
1 Week
Machine Teaching for Autonomous AI (Coursera) Coursera
University of Washington

Machine Teaching for Autonomous AI (Coursera)

Just as teachers help students gain new skills, the same is true of artificial intelligence (AI). Machine learning algorithms can adapt and change, much like the learning process itself. Using the machine teaching paradigm, a subject matter expert (SME) can teach AI to improve and optimize a variety of systems and processes. The result is an autonomous AI system.

Aug 10th 2026
4 Weeks
Google Cloud Product Fundamentals em Português Brasileiro (Coursera) Coursera
Google Cloud

Google Cloud Product Fundamentals em Português Brasileiro (Coursera)

Este curso é uma continuação do "Business Transformation with Google Cloud" e guiará você pela jornada de transformação de uma organização do ponto de vista tecnológico. Explicaremos como as organizações podem fazer a transformação digital usando a tecnologia do Google Cloud nestas categorias: modernização da infraestrutura de TI; melhorias no processo de desenvolvimento dos aplicativos da empresa; uso do machine learning e da inteligência artificial para criar novo valor; a importância de ferramentas de produtividade como o G Suite na realização do trabalho; e compreender as oportunidades e os desafios da gestão do custo que uma infraestrutura de TI na nuvem traz.

Aug 3rd 2026
5-12 Weeks
Artificial Intelligence and legal issues (Coursera) Coursera
Politecnico di Milano

Artificial Intelligence and legal issues (Coursera)

The purpose of the course is to help students understand the legal implications related to the design and use of artificial intelligence systems, providing an overview of the risks and legal protections that can be envisaged and giving an overview of the legislation and legal principles currently applicable on the subject.

Aug 10th 2026
4 Weeks
Responsible AI in the Generative AI Era (Coursera) Coursera
Fractal Analytics

Responsible AI in the Generative AI Era (Coursera)

This one-week microlearning course provides an introduction to the Principles of Responsible AI and how those principles align with the Generative AI or GenAI space. It also informs the learners about the various challenges that Generative AI brings. You will explore the fundamental principles of responsible AI, and understand the need for developing Generative AI tools responsibly.

Aug 3rd 2026
1 Week
LangChain Chat with Your Data (Coursera) Coursera
DeepLearning.AI

LangChain Chat with Your Data (Coursera)

LangChain: Chat With Your Data delves into two main topics: (1) Retrieval Augmented Generation (RAG), a common LLM application that retrieves contextual documents from an external dataset, and (2) a guide to building a chatbot that responds to queries based on the content of your documents, rather than the information it has learned in training.

Aug 10th 2026
1 Week
Artificial Intelligence for Breast Cancer Detection (Coursera) Coursera
Johns Hopkins University

Artificial Intelligence for Breast Cancer Detection (Coursera)

Through interactive lectures and module exercises, this course illustrates the potential of artificial intelligence in breast imaging. Topics include an introduction of breast cancer and breast imaging, introduction to artificial intelligence in image analysis and computer image processing of cancer detection. The course intends to provide students basic understanding of artificial intelligence approaches to breast cancer detection.

Aug 10th 2026
4 Weeks