Introduction to AI in the Data Center (Coursera)

Offered by NVIDIA,
Introduction to AI in the Data Center (Coursera)

Welcome to the Introduction to AI in the Data Center Course! As you know, Artificial Intelligence, or AI, is transforming society in many ways. From speech recognition to improved supply chain management, AI technology provides enterprises with the compute power, tools, and algorithms their teams need to do their life’s work.

Class Deals by MOOC List - Click here and see Coursera's Active Discounts, Deals, and Promo Codes.

But how does AI work in a Data Center? What hardware and software infrastructure are needed?
These are some of the questions that this course will help you address.
This course will cover an introduction to concepts and terminology that will help you start the journey to AI and GPU computing in the data center.
You will learn about:

  • AI and AI use cases, Machine Learning, Deep Learning, and how training and inference happen in a Deep Learning Workflow.
  • The history and architecture of GPUs, how they differ from CPUs, and how they are revolutionizing AI.
  • Deep learning frameworks, AI software stack, and considerations when deploying AI workloads on a data center on prem, in the cloud, on a hybrid model, or on a multi-cloud environment. 
  • Requirements for multi-system AI clusters, considerations for infrastructure planning, including servers, networking, and storage and tools for cluster management, monitoring and orchestration.

This course is part of the preparation material for the NVIDIA Certified Associate - ”AI in the Data Center” certification.
This certification will take your expertise to the next level and support your professional development.
Who should take this course?

  • IT Professionals
  • System and Network Administrators
  • DevOps
  • Data Center Professionals

No prior experience required.
This is an introduction course to AI and GPU computing in the data center.
So let's get started!

What You Will Learn

  • What is AI and AI use cases, Machine Learning, Deep Leaning, and how training and inference happen in a Deep Learning Workflow.
  • The history and architecture of GPUs, how they differ from CPUs, and how they are revolutionizing AI.
  • Become familiar with deep learning frameworks, AI software stack, and considerations when deploying AI workloads on a data center on prem or cloud.
  • Requirements for multi-system AI clusters and considerations for infrustructure planning, including servers, networking, storage and tools.

Syllabus

WEEK 1
Introduction to GPU Computing | NVIDIA Training
In this module you will see AI use cases in different industries, the concepts of AI, Machine Learning (ML) and Deep Learning (DL), understand what a GPU is, the differences between a GPU and a CPU.
You will learn about the software ecosystem that has allowed developers to make use of GPU computing for data science and considerations when deploying AI workloads on a data center on prem, in the cloud, on a hybrid model, or on a multi-cloud environment.

WEEK 2
Rack Level Considerations | NVIDIA Training
In this module we will cover rack level considerations when deploying AI clusters.
You will learn about requirements for multi-system AI clusters, storage and networking considerations for such deployments, and an overview of NVIDIA reference architectures, which provide best practices to design systems for AI workloads.

WEEK 3
Data Center Level Considerations | NVIDIA Training
This unit covers  data center level considerations  when deploying AI clusters, such as infrastructure provisioning and workload management, orchestration and job scheduling, tools for cluster management and monitoring, and power and cooling considerations for data center deployments. 
Lastly, you will learn about AI infrastructure offered by NVIDIA partners through the DGX-ready data center colocation program.

WEEK 4
Course Completion Quiz - Introduction to AI in the Data Center
It is highly recommended that you complete all the course activities before you begin the quiz.
Good luck!

Go to Class
MOOC List is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Related Courses

Structuring Machine Learning Projects (Coursera) Coursera
DeepLearning.AI

Structuring Machine Learning Projects (Coursera)

You will learn how to build a successful machine learning project. If you aspire to be a technical leader in AI, and know how to set direction for your team's work, this course will show you how. Much of this content has never been taught elsewhere, and is drawn from my experience building and shipping many deep learning products. This course also has two "flight simulators" that let you practice decision-making as a machine learning project leader. This provides "industry experience" that you might otherwise get only after years of ML work experience.

Jun 22nd 2026
2 Weeks
Practical Machine Learning (Coursera) Coursera
Johns Hopkins University

Practical Machine Learning (Coursera)

One of the most common tasks performed by data scientists and data analysts are prediction and machine learning. This course will cover the basic components of building and applying prediction functions with an emphasis on practical applications. The course will provide basic grounding in concepts such as training and tests sets, overfitting, and error rates.

Jun 22nd 2026
4 Weeks
Machine Learning: Classification (Coursera) Coursera
University of Washington

Machine Learning: Classification (Coursera)

Case Studies: Analyzing Sentiment & Loan Default Prediction. In our case study on analyzing sentiment, you will create models that predict a class (positive/negative sentiment) from input features (text of the reviews, user profile information,...). In our second case study for this course, loan default prediction, you will tackle financial data, and predict when a loan is likely to be risky or safe for the bank.

Jun 22nd 2026
5-12 Weeks
Getting started with TensorFlow 2 (Coursera) Coursera
Imperial College London

Getting started with TensorFlow 2 (Coursera)

Welcome to this course on Getting started with TensorFlow 2! In this course you will learn a complete end-to-end workflow for developing deep learning models with Tensorflow, from building, training, evaluating and predicting with models using the Sequential API, validating your models and including regularisation, implementing callbacks, and saving and loading models.

Jun 22nd 2026
5-12 Weeks
Recommender Systems: Evaluation and Metrics (Coursera) Coursera
University of Minnesota

Recommender Systems: Evaluation and Metrics (Coursera)

In this course you will learn how to evaluate recommender systems. You will gain familiarity with several families of metrics, including ones to measure prediction accuracy, rank accuracy, decision-support, and other factors such as diversity, product coverage, and serendipity. You will learn how different metrics relate to different user goals and business goals.

Jun 22nd 2026
4 Weeks
Probabilistic Graphical Models 2: Inference (Coursera) Coursera
Stanford University

Probabilistic Graphical Models 2: Inference (Coursera)

Probabilistic graphical models (PGMs) are a rich framework for encoding probability distributions over complex domains: joint (multivariate) distributions over large numbers of random variables that interact with each other. These representations sit at the intersection of statistics and computer science, relying on concepts from probability theory, graph algorithms, machine learning, and more.

Jun 22nd 2026
5-12 Weeks
AI for Medical Diagnosis (Coursera) Coursera
DeepLearning.AI

AI for Medical Diagnosis (Coursera)

AI is transforming the practice of medicine. It’s helping doctors diagnose patients more accurately, make predictions about patients’ future health, and recommend better treatments. As an AI practitioner, you have the opportunity to join in this transformation of modern medicine. If you're already familiar with some of the math and coding behind AI algorithms, and are eager to develop your skills further to tackle challenges in the healthcare industry, then this specialization is for you. No prior medical expertise is required!

Jun 22nd 2026
3 Weeks
Device-based Models with TensorFlow Lite (Coursera) Coursera
DeepLearning.AI

Device-based Models with TensorFlow Lite (Coursera)

Bringing a machine learning model into the real world involves a lot more than just modeling. This Specialization will teach you how to navigate various deployment scenarios and use data more effectively to train your model. This second course teaches you how to run your machine learning models in mobile applications. You’ll learn how to prepare models for a lower-powered, battery-operated devices, then execute models on both Android and iOS platforms. Finally, you’ll explore how to deploy on embedded systems using TensorFlow on Raspberry Pi and microcontrollers.

Jun 22nd 2026
4 Weeks
Learn to code with AI (Coursera) Coursera
Scrimba

Learn to code with AI (Coursera)

Imagine waking up tomorrow as a web developer. What would you want to build? With AI tools like ChatGPT, you're already a developer, regardless of your experience, if you know how to work with them. So in this course, you'll build functional, interactive front-end projects while learning how to write effective prompts and debug and refine your code with the help of AI.

Jun 24th 2026
2 Weeks
Machine Learning with Python (Coursera) Coursera
IBM

Machine Learning with Python (Coursera)

This course dives into the basics of machine learning using an approachable, and well-known programming language, Python. In this course, we will be reviewing two main components: First, you will be learning about the purpose of Machine Learning and where it applies to the real world. Second, you will get a general overview of Machine Learning topics such as supervised vs unsupervised learning, model evaluation, and Machine Learning algorithms.

Jun 22nd 2026
5-12 Weeks