Operationalizing LLMs on Azure (Coursera)

Offered by Duke University,
Operationalizing LLMs on Azure (Coursera)

This course is designed for individuals at both an intermediate and beginner level, including data scientists, AI enthusiasts, and professionals seeking to harness the power of Azure for Large Language Models (LLMs). Tailored for those with foundational programming experience and familiarity with Azure basics, this comprehensive program takes you through a four-week journey.

Class Deals by MOOC List - Click here and see Coursera's Active Discounts, Deals, and Promo Codes.

In the first week, you'll delve into Azure's AI services and the Azure portal, gaining insights into large language models, their functionalities, and strategies for risk mitigation. Subsequent weeks cover practical applications, including leveraging Azure Machine Learning, managing GPU quotas, deploying models, and utilizing the Azure OpenAI Service. As you progress, the course explores nuanced query crafting, Semantic Kernel implementation, and advanced strategies for optimizing interactions with LLMs within the Azure environment. The final week focuses on architectural patterns, deployment strategies, and hands-on application building using RAG, Azure services, and GitHub Actions workflows. Whether you're a data professional or AI enthusiast, this course equips you with the skills to deploy, optimize, and build robust large-scale applications leveraging Azure and Large Language Models.
This course is part of the Large Language Model Operations (LLMOps) Specialization.

What you'll learn

  • Gain proficiency in leveraging Azure for deploying and managing Large Language Models (LLMs).
  • Develop advanced query crafting skills using Semantic Kernel to optimize interactions with LLMs within the Azure environment.
  • Acquire hands-on experience in implementing patterns and deploying applications with Retrieval Augmented Generation (RAG)

Syllabus

Introduction to LLMOps with Azure
This week, you will learn how to get started with Azure and its AI services through an introduction to the Azure portal, and key offerings like Azure Machine Learning. You will also gain an understanding of large language models, including how they work, their benefits and risks, and strategies for mitigating those risks. Finally, you will be introduced to options for discovering, evaluating, and deploying pre-trained LLMs in Azure, including leveraging prompt engineering for responsible data grounding.

LLMs with Azure
This week, you will learn to leverage Azure for Large Language Models (LLMs) by using Azure Machine Learning through its compute resources and managing GPU quotas and model deployments as well as Azure OpenAI Service. You will apply this knowledge by deploying a model and using its inference API using the Python programming language.

Extending with Functions and Plugins
This week, you will discover the art of crafting nuanced queries for Large Language Models (LLMs) in Azure through the implementation of Semantic Kernel. You will gain insights into refining prompts, understand the dynamics of using system prompts, and explore advanced strategies to optimize your interaction with LLMs. You will apply these techniques hands-on to enhance your proficiency in leveraging Semantic Kernel within the Azure environment.

Building an End-to-End LLM application in Azure
This week, you will explore architectural patterns and deployment of large language model applications. By studying RAG, Azure services, and GitHub Actions, you will learn how to build robust applications. You will apply your learning by implementing RAG with Azure search, creating GitHub Actions workflows, and deploying an end-to-end application.

Go to Class
MOOC List is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Related Courses

Enhancing Educational Content with Fliki AI's Text-to-Speech (Coursera) Coursera
Coursera Instructor Network

Enhancing Educational Content with Fliki AI's Text-to-Speech (Coursera)

In a world where information is readily available, the ability to effectively communicate and engage an audience has become crucial. With the power of Fliki AI, a cutting-edge text-to-speech and video creation platform, you can transform educational content into captivating and informative multimedia experiences.

Sep 28th 2026
1 Week
Security for Artificial Intelligence Software and Services (Coursera) Coursera
Board Infinity

Security for Artificial Intelligence Software and Services (Coursera)

The "Security Basics for Artificial Intelligence Software and Services" course provides an in-depth exploration of security measures and best practices in the context of AI. Spanning two comprehensive modules, the course begins with an introduction to the fundamentals of AI security, including ethical considerations and common threats. It then progresses to practical strategies for implementing robust security in AI development, such as secure coding, vulnerability assessment, and adherence to compliance standards.

Sep 28th 2026
2 Weeks
Ethical AI Use (Coursera) Coursera
University System of Georgia

Ethical AI Use (Coursera)

The "Ethical AI Use" course delves into the critical intersection of technology and ethics, focusing on the responsible development and deployment of artificial intelligence (AI). Participants will explore the evolution of AI, distinguishing between the two fundamental types, and examine the ethical considerations inherent in the realm of generative AI.

Sep 28th 2026
2 Weeks
Frontiers in Dentistry (Coursera) Coursera
University of Pennsylvania

Frontiers in Dentistry (Coursera)

In this course, Frontiers in Dentistry, you will be able to explore some of the latest advances in the field of dental medicine. The innovations in therapeutic techniques as well as our understanding of the biomedical sciences have been made possible by our research enterprise which integrates the latest emerging technology along with interdisciplinary collaborations.

Sep 28th 2026
5-12 Weeks
Generative AI in HR - Impact and Application of Gen AI (Coursera) Coursera
Board Infinity

Generative AI in HR - Impact and Application of Gen AI (Coursera)

"Generative AI in HR - Impact and Application of Gen AI HR Tools" is a comprehensive course designed to explore the transformative role of generative AI in human resources. Across two modules, this course covers the fundamentals of generative AI, its applications in HR, and the broader implications for the future. It delves into practical uses in recruitment, employee engagement, and training, as well as critical discussions on ethics, bias, and privacy. Emerging trends and predictive analytics are also explored, preparing HR professionals for the evolving landscape of AI in the workplace.

Sep 28th 2026
2 Weeks
Build and Execute an Organisational AI Strategy (Coursera) Coursera
Coursera Instructor Network

Build and Execute an Organisational AI Strategy (Coursera)

AI is the hottest, most exciting technology to burst onto the scene in recent years. Its impact is so big, it is revolutionizing industries all over the globe. If you are an executive, you may be wondering how to harness AI's incredible power for your organization. Well, this course is going to show you how to do just that.

Sep 28th 2026
4 Weeks
AI and the Illusion of Intelligence (Coursera) Coursera
Copenhagen Business School

AI and the Illusion of Intelligence (Coursera)

Will AI soon be surpassing humans? This is rapidly becoming one of the central questions of our time -- but it is the wrong question. In this course, we will provide a non-technical look at where AI has come from, and where it is going. We will see that there is no reason to expect that AI will be surpassing humans. Instead, what we are learning to create with AI is the illusion of intelligence.

Sep 28th 2026
4 Weeks
Google Cloud Product Fundamentals em Português Brasileiro (Coursera) Coursera
Google Cloud

Google Cloud Product Fundamentals em Português Brasileiro (Coursera)

Este curso é uma continuação do "Business Transformation with Google Cloud" e guiará você pela jornada de transformação de uma organização do ponto de vista tecnológico. Explicaremos como as organizações podem fazer a transformação digital usando a tecnologia do Google Cloud nestas categorias: modernização da infraestrutura de TI; melhorias no processo de desenvolvimento dos aplicativos da empresa; uso do machine learning e da inteligência artificial para criar novo valor; a importância de ferramentas de produtividade como o G Suite na realização do trabalho; e compreender as oportunidades e os desafios da gestão do custo que uma infraestrutura de TI na nuvem traz.

Sep 28th 2026
5-12 Weeks
How to Get Into AI (Coursera) Coursera
University of Leeds

How to Get Into AI (Coursera)

AI forms the basis for all computer learning and is the future of all complex decision-making. As such it is becoming increasingly prevalent in daily life. As a result, the outlook is bright for artificial intelligence jobs. In this course, you will learn how to navigate the dynamic field of artificial intelligence (AI), exploring its applications and the evolving landscape of AI-related careers.

Sep 28th 2026
2 Weeks
Google Cloud Product Fundamentals en Español (Coursera) Coursera
Google Cloud

Google Cloud Product Fundamentals en Español (Coursera)

Este curso, que es una continuación de Business Transformation with Google Cloud, le permitirá conocer la perspectiva tecnológica de la transformación de una organización. Para ser más específicos, explicaremos cómo la tecnología de Google Cloud puede transformar digitalmente una organización en los siguientes aspectos: modernizar la infraestructura de TI; mejorar la forma en que los equipos desarrollan las aplicaciones que utiliza la empresa; saber cómo aprovechar el aprendizaje automático y la inteligencia artificial para generar más valor; advertir el rol fundamental de las herramientas de productividad basadas en la nube, como G Suite, para cumplir con el trabajo, y comprender los desafíos y las oportunidades de la administración de costos que trae aparejados una infraestructura de TI cambiante basada en la nube.

Sep 28th 2026
5-12 Weeks