Large Language Models with Azure (edX)

Master Large Language Model Operations on Azure

• Unlock Azure's full potential for deploying & optimizing Large Language Models (LLMs)
• Build robust LLM applications leveraging Azure Machine Learning & OpenAI Service
• Implement architectural patterns & GitHub Actions workflows for streamlined MLOps

Course Highlights:

• Explore Azure AI services and LLM capabilities
• Mitigate risks with foundational strategies
• Leverage Azure ML for model deployment & management
• Optimize GPU quotas for performance & cost-efficiency
• Craft advanced queries for enriched LLM interactions
• Implement Semantic Kernel for enhanced query results
• Dive into architectural patterns like RAG for scalable architectures
• Build end-to-end LLM apps using Azure services & GitHub Actions

Ideal for data professionals, AI enthusiasts & Azure users looking to harness cutting-edge language AI capabilities. Gain practical MLOps skills through tailored modules & hands-on projects.
This course is part of the Large Language Model Operations (LLMOps) Professional Certificate.

What you'll learn

• Gain proficiency in leveraging Azure for deploying and managing Large Language Models (LLMs).
• Develop advanced query crafting skills using Semantic Kernel to optimize interactions with LLMs within the Azure environment.
• Acquire hands-on experience in implementing patterns and deploying applications with Retrieval Augmented Generation (RAG)

Syllabus

Week 1: Introduction to LLMOps with Azure
\\- Discover pre-trained LLMs in Azure and deploy basic LLM endpoints
\\- Identify strategies for mitigating risks when using LLMs
\\- Explain how large language models work and their potential benefits and risks
\\- Describe the core Azure services and tools for working with AI solutions like Azure ML and the Azure OpenAI Service

Week 2: LLMs with Azure

• Use Azure Machine Learning, including GPU quota management, compute resource creation, model deployment, and utilization of the inference API
• Use the Azure OpenAI Service and its playground by deploying models and creating required resources
• Apply your comprehension of keys, endpoints, and Python examples to integrate Azure OpenAI APIs, monitor usage, and ensure proper resource cleanup

Week 3: Extending with Functions and Plugins

• Use Semantic Kernel to create advanced, context-aware prompts for large language models
• Define custom functions to extend system capabilities
• Build a microservice for reusable functions to streamline system extensions
• Implement functions using external APIs and microservices to customize model behavior

Week 4: Building an End-to-End LLM application in Azure

• Understand architectural patterns like RAG for building LLM applications
• Use Azure AI Search to create search indexes and embeddings to power RAG
• Build GitHub Actions workflows to automate testing and deployment of LLM apps
• Deploy an end-to-end LLM application leveraging RAG, Azure, and GitHub Actions