Introduction to AI in the Data Center (Coursera)

Offered by NVIDIA,
Introduction to AI in the Data Center (Coursera)

Welcome to the Introduction to AI in the Data Center Course! As you know, Artificial Intelligence, or AI, is transforming society in many ways. From speech recognition to improved supply chain management, AI technology provides enterprises with the compute power, tools, and algorithms their teams need to do their life’s work.

Class Deals by MOOC List - Click here and see Coursera's Active Discounts, Deals, and Promo Codes.

But how does AI work in a Data Center? What hardware and software infrastructure are needed?
These are some of the questions that this course will help you address.
This course will cover an introduction to concepts and terminology that will help you start the journey to AI and GPU computing in the data center.
You will learn about:

  • AI and AI use cases, Machine Learning, Deep Learning, and how training and inference happen in a Deep Learning Workflow.
  • The history and architecture of GPUs, how they differ from CPUs, and how they are revolutionizing AI.
  • Deep learning frameworks, AI software stack, and considerations when deploying AI workloads on a data center on prem, in the cloud, on a hybrid model, or on a multi-cloud environment. 
  • Requirements for multi-system AI clusters, considerations for infrastructure planning, including servers, networking, and storage and tools for cluster management, monitoring and orchestration.

This course is part of the preparation material for the NVIDIA Certified Associate - ”AI in the Data Center” certification.
This certification will take your expertise to the next level and support your professional development.
Who should take this course?

  • IT Professionals
  • System and Network Administrators
  • DevOps
  • Data Center Professionals

No prior experience required.
This is an introduction course to AI and GPU computing in the data center.
So let's get started!

What You Will Learn

  • What is AI and AI use cases, Machine Learning, Deep Leaning, and how training and inference happen in a Deep Learning Workflow.
  • The history and architecture of GPUs, how they differ from CPUs, and how they are revolutionizing AI.
  • Become familiar with deep learning frameworks, AI software stack, and considerations when deploying AI workloads on a data center on prem or cloud.
  • Requirements for multi-system AI clusters and considerations for infrustructure planning, including servers, networking, storage and tools.

Syllabus

WEEK 1
Introduction to GPU Computing | NVIDIA Training
In this module you will see AI use cases in different industries, the concepts of AI, Machine Learning (ML) and Deep Learning (DL), understand what a GPU is, the differences between a GPU and a CPU.
You will learn about the software ecosystem that has allowed developers to make use of GPU computing for data science and considerations when deploying AI workloads on a data center on prem, in the cloud, on a hybrid model, or on a multi-cloud environment.

WEEK 2
Rack Level Considerations | NVIDIA Training
In this module we will cover rack level considerations when deploying AI clusters.
You will learn about requirements for multi-system AI clusters, storage and networking considerations for such deployments, and an overview of NVIDIA reference architectures, which provide best practices to design systems for AI workloads.

WEEK 3
Data Center Level Considerations | NVIDIA Training
This unit covers  data center level considerations  when deploying AI clusters, such as infrastructure provisioning and workload management, orchestration and job scheduling, tools for cluster management and monitoring, and power and cooling considerations for data center deployments. 
Lastly, you will learn about AI infrastructure offered by NVIDIA partners through the DGX-ready data center colocation program.

WEEK 4
Course Completion Quiz - Introduction to AI in the Data Center
It is highly recommended that you complete all the course activities before you begin the quiz.
Good luck!

Go to Class
MOOC List is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Related Courses

Artificial Intelligence: Ethics & Societal Challenges (Coursera) Coursera
Lund University

Artificial Intelligence: Ethics & Societal Challenges (Coursera)

Artificial Intelligence: Ethics & Societal Challenges is a four-week course that explores ethical and societal aspects of the increasing use of artificial intelligent technologies (AI). The aim of the course is to raise awareness of ethical and societal aspects of AI and to stimulate reflection and discussion upon implications of the use of AI in society.

Sep 21st 2026
4 Weeks
AI Concepts and Strategy (Coursera) Coursera
Rutgers University

AI Concepts and Strategy (Coursera)

Artificial intelligence (AI) is rapidly evolving as a multidimensional paradigm, with critical implications for individuals, communities, organizations, businesses, national and regional economies and human society at large. This unique course will help you understand AI on three dimensions: Practice, Principles & Strategy. The course is introductory in nature but will provide a reasonably rigorous learning experience towards gaining a state of the art applied and philosophical overview of AI.

Sep 21st 2026
4 Weeks
Machine Learning for All (Coursera) Coursera
University of London

Machine Learning for All (Coursera)

Machine Learning, often called Artificial Intelligence or AI, is one of the most exciting areas of technology at the moment. We see daily news stories that herald new breakthroughs in facial recognition technology, self driving cars or computers that can have a conversation just like a real person. Machine Learning technology is set to revolutionise almost any area of human life and work, and so will affect all our lives, and so you are likely to want to find out more about it.

Sep 21st 2026
4 Weeks
Determining AI Needs (Coursera) Coursera
Fred Hutchinson Cancer Center

Determining AI Needs (Coursera)

There are a ever increasing number of options, strategies and solutions for integrating AI solutions into a project. It can feel overwhelming to understand what these options entail let alone understand how to decide what solution best fits a use case. In this course we aim to give individuals the basic info they need to make basic plans for integrating AI tools into their project.

Sep 21st 2026
1 Week
Attention Mechanism (Coursera) Coursera
Google Cloud

Attention Mechanism (Coursera)

This course will introduce you to the attention mechanism, a powerful technique that allows neural networks to focus on specific parts of an input sequence. You will learn how attention works, and how it can be used to improve the performance of a variety of machine learning tasks, including machine translation, text summarization, and question answering.

Sep 21st 2026
1 Week
Avoiding AI Harm (Coursera) Coursera
Fred Hutchinson Cancer Center

Avoiding AI Harm (Coursera)

This course is designed for those in roles with decision making power, to help them understand major topics to consider for using and developing Artificial Intelligence (AI) responsibly, including popular Generative AI tools like ChatGPT and others. It covers real-world examples of situations where AI was used in variety of fields and situations in ways hat revealed ethical concerns. Strategies are suggested to avoid doing harm working with AI, including a framework for working responsibly with AI.

Sep 21st 2026
1 Week
Machine Learning: Concepts and Applications (Coursera) Coursera
University of Chicago

Machine Learning: Concepts and Applications (Coursera)

This course gives you a comprehensive introduction to both the theory and practice of machine learning. You will learn to use Python along with industry-standard libraries and tools, including Pandas, Scikit-learn, and Tensorflow, to ingest, explore, and prepare data for modeling and then train and evaluate models using a wide variety of techniques. Those techniques include linear regression with ordinary least squares, logistic regression, support vector machines, decision trees and ensembles, clustering, principal component analysis, hidden Markov models, and deep learning.

Sep 21st 2026
5-12 Weeks
Generative AI for Leaders (Coursera) Coursera
Vanderbilt University

Generative AI for Leaders (Coursera)

Leaders are constantly seeking innovative tools to amplify their impact. Dive into the realm of Generative AI, a groundbreaking technology poised to redefine the leadership landscape more profoundly than the Internet itself. This course offers a comprehensive journey into understanding, applying, and mastering Generative AI as a robust tool to amplify leadership capabilities.

Sep 21st 2026
3 Weeks
Using R for Regression and Machine Learning in Investment (Coursera) Coursera
Sungkyunkwan University - SKKU

Using R for Regression and Machine Learning in Investment (Coursera)

In this course, the instructor will discuss various uses of regression in investment problems, and she will extend the discussion to logistic, Lasso, and Ridge regressions. At the same time, the instructor will introduce various concepts of machine learning. You can consider this course as the first step toward using machine learning methodologies in solving investment problems. The course will cover investment analysis topics, but at the same time, make you practice it using R programming. This course's focus is to train you to use various regression methodologies for investment management that you might need to do in your job every day and make you ready for more advanced topics in machine learning.

Sep 21st 2026
2 Weeks
Exploring AI Possibilities (Coursera) Coursera
Fred Hutchinson Cancer Center

Exploring AI Possibilities (Coursera)

This course on Exploring AI Possibilities for Decision Makers explores the growing use of AI across disciplines and its potential benefits and challenges. The course covers necessary context, such as discussing what AI is, how it works, and key definitions in AI. Through exploring the many AI possibilities at your fingertips, you will build leadership skills for helping your business or community work more efficiently, creatively, and ethically.

Sep 21st 2026
1 Week
AI-Driven Attribution Testing (Coursera) Coursera
Board Infinity

AI-Driven Attribution Testing (Coursera)

Welcome to AI-Driven Attribution Testing course an engaging and comprehensive course designed to guide you through the fundamental concepts and practical applications of attribution testing powered by artificial intelligence. This course is most suitable for marketers, data analysts, data scientists, and business leaders who aim to leverage data-driven insights for decision-making. It's also beneficial for students and professionals with a keen interest in the convergence of AI, data analysis, and marketing.

Sep 21st 2026
2 Weeks