EdX

AI Skills for Engineers: Data Engineering and Data Pipelines (edX)

AI Skills for Engineers: Data Engineering and Data Pipelines (edX)

Good data is central to effective AI applications. This course teaches the basics of data for AI, covering what data is needed, how to extract data from existing databases and basic data skills including setup of a Python notebook environment, basic data exploration and simple data visualizations.

Class Deals by MOOC List - Click here and see EdX's Active Discounts, Deals, and Promo Codes.

Artificial Intelligence and Machine Learning have become central techniques for most services and products, ranging from web-based systems to medical procedures, self-driving cars – even intelligent coffee makers.
Alongside algorithms, data is central to AI applications. Without solid data management, AI projects typically underperform or even fail. Unfortunately, the relevance and complexity of handling data is frequently underestimated.
That’s why we developed this course which covers foundational questions like “Why is data important to AI?” and “What data does AI need?” and covers more application-oriented topics and skills like how to extract, load and query data using an SQL pipeline.
In the second part of the course, you will learn basic data engineering skills, including how to setup your Python notebook environment, explore data with advanced pandas functions, and create simple and clear data visualizations.
This introductory course is targeted at learners with little experience in data management or Python-based data management who want to develop Python-based AI applications in the future. The course covers a brief introduction into data management for AI, relational data management (e.g., SQL), and practical data handling skills in Python, pandas, and Jupyter.
This allows you to build a foundation to prepare for future AI and Machine Learning development with Python.

What you'll learn

  • Why Data Management is central to AI applications
  • What kind of data these applications need
  • How to obtain data for AI applications
  • How to extract and query data from existing databases using SQL
  • How to setup your Python notebooks
  • How to use the pandas library to work with tabular data
  • How to visualize data using the Seaborn library

Syllabus

Week 1:
We ask why we should care about data management for Artificial Intelligence and Machine Learning (ML) systems.
We examine which data are needed in the ML lifecycle and what properties that data should have.
We discuss the effort and time needed for data management activities, and look at possible data sources.

Week 2:
The basic key concepts of data management, such as databases, data models and data schemas are all introduced.
The Relational Data Model is explained and contrasted with the Single-Table Model (like CSV and Excel) and Document Models.

Week 3:
We show how to extract data from existing relational databases using SQL queries and converting the query results into CSV files for further processing using pandas in Python notebooks.

Week 4:
The different ways setoff setting up and running Python notebooks are covered, including cloud-based notebooks and local notebooks.
We will take you step by step through the process of setting up your conda environment and installing Jupyter and pandas libraries.
You will learn how to run notebooks in VS code.

Week 5:
Become a pandas expert.
Explore the essential functionalities of pandas and, most importantly, write elegant and efficient Python pandas code to process and engineer tabular data.

Week 6:
You will learn how to make simple and clear scientific figures in Python using the Seaborn library.
Use the core functions provided by Seaborn to make beautiful statistical plots.

Go to Class
MOOC List is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Related Courses

Visualizing Data with Python (edX) EdX
IBM

Visualizing Data with Python (edX)

Data visualization is the graphical representation of data in order to interactively and efficiently convey insights to clients, customers, and stakeholders in general. "A picture is worth a thousand words." We are all familiar with this expression. It especially applies when trying to explain the insights obtained from the analysis of increasingly large datasets. Data visualization plays an essential role in the representation of both small and large-scale data. One of the key skills of a data scientist is the ability to tell a compelling story, visualizing data and findings in an approachable and stimulating way.

Self Paced
Self-Paced
AI skills: Introduction to Unsupervised, Deep and Reinforcement Learning (edX) EdX
Delft University of Technology,DelftX

AI skills: Introduction to Unsupervised, Deep and Reinforcement Learning (edX)

Learn the fundamentals and principal AI concepts about clustering, dimensionality reduction, reinforcement learning and deep learning to solve real-life problems. In this course you will learn the basics of several machine learning topics to help you solve real life challenges. Unsupervised learning techniques such as clustering and dimensionality reduction are useful to make sense of large and/or high dimensional datasets that are not annotated. Deep learning is a supervised learning technique that is useful to train neural networks to solve more complicated classification and regression tasks. Finally, reinforcement learning techniques can be used to train AI agents that interact with an environment.

Self Paced
Self-Paced
Tech for Good: The Role of ICT in Achieving the SDGs (edX) EdX
SDGAcademyX,SDG Academy

Tech for Good: The Role of ICT in Achieving the SDGs (edX)

What opportunities and challenges do digital technologies present for the development of our society? Tech for Good was developed by UNESCO and Cetic, the Brazilian Network Information Center’s Regional Center for Studies on the Development of the Information Society. It brings together thought leaders and changemakers in the fields of information and communication technologies (ICT) and sustainable development to show how digital technologies are empowering billions of people around the world by providing access to education, healthcare, banking, and government services; and how “big data” is being used to inform smarter, evidence-based policies to improve people’s lives in fundamental ways.

Self Paced
Self-Paced
Data Creation and Collection for Artificial Intelligence via Crowdsourcing (edX) EdX
Delft University of Technology,DelftX

Data Creation and Collection for Artificial Intelligence via Crowdsourcing (edX)

A one-stop shop to get started on the key considerations about data for AI! Learn how crowdsourcing offers a viable means to leverage human intelligence at scale for data creation, enrichment and interpretation, demonstrating a great potential to improve both the performance of AI systems and their trustworthiness and increase the adoption of AI in general.

Self Paced
5-12 Weeks
AI in Practice: Preparing for AI (edX) EdX
Delft University of Technology,DelftX

AI in Practice: Preparing for AI (edX)

Learn to recognize and understand the implications of Artificial Intelligence for organizations, and the importance of compliance and ethics when AI is applied in practice. This course is not about difficult algorithms and complex programming; it is a course for anyone interested in learning about the benefits and implications of AI when applied in practical settings.

Self Paced
Self-Paced
Digital Transformation Strategy: Discovering and Reaching New Markets (edX) EdX
University of Maryland, College Park,University System of Maryland - USM,USMx,UMD

Digital Transformation Strategy: Discovering and Reaching New Markets (edX)

Learn key concepts of strategy, IT, and Innovation to bring emerging technologies to market through digital channels. This course is different – it’s a sample of the most important key concepts and techniques needed to develop digital strategies and bring them to market.

Self Paced
Self-Paced
Excel for Everyone: Data Management (edX) EdX
The University of British Columbia,UBCx

Excel for Everyone: Data Management (edX)

Further your Excel skills to manage larger datasets and more complex data wrangling, management and modelling. This intermediate Excel course builds on the teachings of the introductory Core Foundations course, teaching you to leverage the power of data calculations and reports to make informed personal or organizational decisions.

Self Paced
Self-Paced
Excel: Gestión de datos (edX) EdX
Universitat Politècnica de València,UPValenciaX

Excel: Gestión de datos (edX)

En este curso profundizarás en las herramientas para el tratamiento y manejo de datos que ofrece Excel. Este es un curso de nivel intermedio que te permitirá trabajar con datos para su tratamiento y extraer conclusiones mediante el agrupamiento de datos, el uso de tablas y gráficos dinámicos, la realización de análisis de hipótesis y la vinculación de datos de otras hojas de cálculo.

Self Paced
Self-Paced
Gobernanza de datos personales en la era digital (edX) EdX
The Pontificia Universidad Javeriana,JaverianaX

Gobernanza de datos personales en la era digital (edX)

Law

Aprende qué es la gobernanza de datos personales y desarrolla habilidades para diseñar e implementar leyes y políticas públicas en materia de datos personales en la era digital. Este curso en línea te ayudará a comprender qué es la gobernanza de datos, los criterios que deben tener en cuenta quienes formulan política públicas al momento de redactar o desarrollar leyes, regulaciones o políticas en materia de protección de datos y privacidad, así como aspectos prácticos de los programas de gobernanza de datos.

Self Paced
Self-Paced