Duke University

Operationalizing LLMs on Azure

This course is part of Large Language Model Operations (LLMOps) Specialization

Taught in English

Some content may not be translated

Noah Gift
Alfredo Deza
Derek Wales

Instructors: Noah Gift

Included with Coursera Plus

Course

Gain insight into a topic and learn the fundamentals

Intermediate level

Recommended experience

10 hours (approximately)
Flexible schedule
Learn at your own pace

What you'll learn

  • Gain proficiency in leveraging Azure for deploying and managing Large Language Models (LLMs).

  • Develop advanced query crafting skills using Semantic Kernel to optimize interactions with LLMs within the Azure environment.

  • Acquire hands-on experience in implementing patterns and deploying applications with Retrieval Augmented Generation (RAG)

Details to know

Shareable certificate

Add to your LinkedIn profile

Recently updated!

January 2024

Assessments

4 quizzes

Course

Gain insight into a topic and learn the fundamentals

Intermediate level

Recommended experience

10 hours (approximately)
Flexible schedule
Learn at your own pace

See how employees at top companies are mastering in-demand skills

Placeholder

Build your subject-matter expertise

This course is part of the Large Language Model Operations (LLMOps) Specialization
When you enroll in this course, you'll also be enrolled in this Specialization.
  • Learn new concepts from industry experts
  • Gain a foundational understanding of a subject or tool
  • Develop job-relevant skills with hands-on projects
  • Earn a shareable career certificate
Placeholder
Placeholder

Earn a career certificate

Add this credential to your LinkedIn profile, resume, or CV

Share it on social media and in your performance review

Placeholder

There are 4 modules in this course

This week, you will learn how to get started with Azure and its AI services through an introduction to the Azure portal, and key offerings like Azure Machine Learning. You will also gain an understanding of large language models, including how they work, their benefits and risks, and strategies for mitigating those risks. Finally, you will be introduced to options for discovering, evaluating, and deploying pre-trained LLMs in Azure, including leveraging prompt engineering for responsible data grounding.

What's included

21 videos8 readings1 quiz1 discussion prompt

This week, you will learn to leverage Azure for Large Language Models (LLMs) by using Azure Machine Learning through its compute resources and managing GPU quotas and model deployments as well as Azure OpenAI Service. You will apply this knowledge by deploying a model and using its inference API using the Python programming language.

What's included

18 videos4 readings1 quiz

This week, you will discover the art of crafting nuanced queries for Large Language Models (LLMs) in Azure through the implementation of Semantic Kernel. You will gain insights into refining prompts, understand the dynamics of using system prompts, and explore advanced strategies to optimize your interaction with LLMs. You will apply these techniques hands-on to enhance your proficiency in leveraging Semantic Kernel within the Azure environment.

What's included

19 videos3 readings1 quiz

This week, you will explore architectural patterns and deployment of large language model applications. By studying RAG, Azure services, and GitHub Actions, you will learn how to build robust applications. You will apply your learning by implementing RAG with Azure search, creating GitHub Actions workflows, and deploying an end-to-end application.

What's included

20 videos7 readings1 quiz

Instructors

Noah Gift
Duke University
35 Courses82,044 learners

Offered by

Duke University

Recommended if you're interested in Cloud Computing

Why people choose Coursera for their career

Felipe M.
Learner since 2018
"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."
Jennifer J.
Learner since 2020
"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."
Larry W.
Learner since 2021
"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."
Chaitanya A.
"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."

New to Cloud Computing? Start here.

Placeholder

Open new doors with Coursera Plus

Unlimited access to 7,000+ world-class courses, hands-on projects, and job-ready certificate programs - all included in your subscription

Advance your career with an online degree

Earn a degree from world-class universities - 100% online

Join over 3,400 global companies that choose Coursera for Business

Upskill your employees to excel in the digital economy

Frequently asked questions