EdX

Python and Pandas for Data Engineering (edX)

Offered by AI (Pragmatic AI Labs),
Python and Pandas for Data Engineering (edX)

Master Python essentials and Pandas for data engineering. Learn to set up development environments, manipulate data, and efficiently solve real-world problems.

Class Deals by MOOC List - Click here and see EdX's Active Discounts, Deals, and Promo Codes.

In this course, you'll gain the Python and Pandas skills essential for data engineering:

  • Set up version-controlled Python environments with necessary libraries
  • Write Python programs using key language features and data structures
  • Manipulate and analyze data using the powerful Pandas library
  • Explore alternative data structures like NumPy arrays and PySpark DataFrames
  • Utilize Vim, Visual Studio Code, and Git for productive development

Whether you're a beginner or have some programming experience, you'll learn to harness Python and Pandas to tackle data engineering challenges. Hands-on exercises reinforce your learning each step of the way.
This course is part of the Data Engineering Foundations Professional Certificate.

What you'll learn

  • Python environment setup and package management
  • Core Python syntax and data structures
  • Pandas DataFrames for data manipulation
  • Alternatives to Pandas for big data
  • Development with Vim, VS Code, and Git

Syllabus

Module 1: Getting Started with Python (14 hours)
\- Overview of Python, Bash and SQL Essentials for Data Engineering (video, 7 minutes)
\- Meet your Course Instructor: Kennedy Behrman (video, 0 minutes)
\- Overview of Key Concepts (video, 5 minutes)
\- Introduction to Setting Up Your Python Environment (video, 0 minutes)
\- Installing Packages with pip in Python (video, 6 minutes)
\- Saving Requirements File in Python (video, 3 minutes)
\- Creating and Using a Python Virtual Environment (video, 5 minutes)
\- Expression Statements in Python (video, 3 minutes)
\- Assignment Statements in Python (video, 5 minutes)
\- Import Statements in Python (video, 4 minutes)
\- Other Simple Statements in Python (video, 5 minutes)
\- Compound Statements in Python (video, 5 minutes)
\- If Statements in Python (video, 6 minutes)
\- While Loops in Python (video, 4 minutes)
\- Functions in Python (video, 7 minutes)
\- Key Terms (reading, 10 minutes)
\- Key Terms (reading, 10 minutes)
\- Meet your Supporting Instructors: Alfredo Deza and Noah Gift (reading, 10 minutes)
\- Course Structure and Discussion Etiquette (reading, 10 minutes)
\- Getting Started and Best Practices (reading, 10 minutes)
\- Key Terms (reading, 10 minutes)
\- Lesson Reflection (reading, 10 minutes)
\- Key Terms (reading, 10 minutes)
\- Lesson Reflection (reading, 10 minutes)
\- Key Terms (reading, 10 minutes)
\- Evaluating to True or False (reading, 10 minutes)
\- Lesson Reflection (reading, 10 minutes)
\- Python Statements (quiz, 30 minutes)
\- Assignment Statements (quiz, 30 minutes)
\- Import Statements (quiz, 30 minutes)
\- If Statements (quiz, 30 minutes)
\- While Loops (quiz, 30 minutes)
\- Quiz-Setting Up Your Python Environment (assignment, 180 minutes)
\- Meet and Greet (optional) (discussion prompt, 10 minutes)
\- Install a Package with the pip Command (ungraded lab, 60 minutes)
\- Export a Requirements File (ungraded lab, 60 minutes)
\- Create a Virtual Environment (ungraded lab, 60 minutes)
\- Practicing with Expression Statements (ungraded lab, 60 minutes)
\- Decorator Functions (ungraded lab, 60 minutes)
\- Setting up a Python Environment (ungraded lab, 60 minutes)

Module 2: Essential Python (11 hours)

  • Introduction to Python Essentials (video, 0 minutes)
  • Sequences in Python (video, 8 minutes)
  • Lists and Tuples in Python (video, 5 minutes)
  • Strings in Python (video, 10 minutes)
  • Creating Range Objects in Python (video, 2 minutes)
  • Creating Dictionaries in Python (video, 4 minutes)
  • Accessing Dictionary Data in Python (video, 3 minutes)
  • Dictionary Views in Python (video, 2 minutes)
  • Sets and Set Operations in Python (video, 6 minutes)
  • List Comprehensions in Python (video, 6 minutes)
  • Generator Expressions in Python (video, 4 minutes)
  • Generator Functions in Python (video, 7 minutes)
  • Key Terms (reading, 10 minutes)
  • Lesson Reflection (reading, 10 minutes)
  • Key Terms (reading, 10 minutes)
  • Lesson Reflection (reading, 10 minutes)
  • Key Terms (reading, 10 minutes)
  • Lesson Reflection (reading, 10 minutes)
  • Essential Python Concepts (quiz, 30 minutes)
  • Sequence Operations (quiz, 30 minutes)
  • Lists and Tuples (quiz, 30 minutes)
  • Range Objects (quiz, 30 minutes)
  • Accessing Data in Dictionaries (quiz, 30 minutes)
  • Sets and Set Operations (quiz, 30 minutes)
  • List Comprehensions (quiz, 30 minutes)
  • Generator Expressions (quiz, 30 minutes)
  • Practicing with Strings in Python (ungraded lab, 60 minutes)
  • Creating Dictionaries in Python (ungraded lab, 60 minutes)
  • Dictionary Views in Python (ungraded lab, 60 minutes)
  • Comprehensions and Generators in Python (ungraded lab, 60 minutes)
  • Practicing Essential Python (ungraded lab, 60 minutes)

Module 3: Data in Python: Pandas and Alternatives (12 hours)

  • Introduction to Data in Python: Pandas and Alternatives (video, 0 minutes)
  • Creating Pandas DataFrames in Python (video, 4 minutes)
  • Investigating Data in a Pandas DataFrame (video, 6 minutes)
  • Selecting Data in a Pandas DataFrame (video, 6 minutes)
  • Manipulating Pandas DataFrames (video, 4 minutes)
  • Updating Pandas DataFrame Data (video, 5 minutes)
  • Applying Functions in a Pandas DataFrame (video, 6 minutes)
  • Creating NumPy Arrays in Python (video, 15 minutes)
  • Spark and PySpark DataFrames in Python (video, 6 minutes)
  • Creating Dask DataFrames in Python (video, 6 minutes)
  • Key Terms (reading, 10 minutes)
  • Lesson Reflection (reading, 10 minutes)
  • Key Terms (reading, 10 minutes)
  • Lesson Reflection (reading, 10 minutes)
  • Key Terms (reading, 10 minutes)
  • Polars (reading, 10 minutes)
  • Lesson Reflection (reading, 10 minutes)
  • Pandas and Alternatives (quiz, 30 minutes)
  • NumPy (quiz, 30 minutes)
  • PySpark (quiz, 30 minutes)
  • Dask (quiz, 30 minutes)
  • Creating DataFrames (ungraded lab, 60 minutes)
  • Looking at Data in DataFrames (ungraded lab, 60 minutes)
  • Selecting Data in a Pandas DataFrame (ungraded lab, 60 minutes)
  • Manipulating DataFrames (ungraded lab, 60 minutes)
  • Updating Data in a DataFrame (ungraded lab, 60 minutes)
  • Applying Functions in a Pandas DataFrame (ungraded lab, 60 minutes)
  • Manipulate DataFrames with Polars to gain insights (ungraded lab, 60 minutes)
  • Pandas and Alternatives (ungraded lab, 60 minutes)

Module 4: Python Development Environments (13 hours)

  • Introduction to Python Development Environments (video, 0 minutes)
  • Introduction to Vim Normal Mode (video, 6 minutes)
  • Switching from Normal to Insert and Visual Modes in Vim (video, 4 minutes)
  • Working with the Vim Command Line (video, 6 minutes)
  • Vim Configuration (video, 3 minutes)
  • Introduction to Visual Studio Code (video, 1 minute)
  • Setting Up Visual Studio Code (video, 2 minutes)
  • Debugging Visual Studio Code (video, 3 minutes)
  • What is Version Control? (video, 3 minutes)
  • Introduction to Git and Git Concepts (video, 7 minutes)
  • Version Control with GitHub (video, 6 minutes)
  • Summary of Python and Pandas for Data Engineering (video, 0 minutes)
  • Key Terms (reading, 10 minutes)
  • Lesson Reflection (reading, 10 minutes)
  • Key Terms (reading, 10 minutes)
  • Lesson Reflection (reading, 10 minutes)
  • Key Terms (reading, 10 minutes)
  • Lesson Reflection (reading, 10 minutes)
  • Next Steps (reading, 10 minutes)
  • Cumulative Python and Pandas for Data Engineering Quiz (quiz, 45 minutes)
  • Insert and Visual Modes (quiz, 30 minutes)
  • Vim Command Line Mode (quiz, 30 minutes)
  • Features of Visual Studio Code (quiz, 30 minutes)
  • Version Control (quiz, 30 minutes)
  • Git Commands (quiz, 30 minutes)
  • Hosted Git (quiz, 30 minutes)
  • Basic Vim Commands (ungraded lab, 60 minutes)
  • Explore Visual Studio Code (ungraded lab, 60 minutes)
  • Visual Studio Code Debugger (ungraded lab, 60 minutes)
  • Setup and Provision a Python Project (ungraded lab, 60 minutes)
  • Pandas Final Challenge: Life Expectancy and Happiness (ungraded lab, 60 minutes)
  • Final Jupyter Sandbox (ungraded lab, 60 minutes)
  • Final VS Code Sandbox (ungraded lab, 60 minutes)
  • Final Sandbox Linux Desktop (ungraded lab, 60 minutes)
Go to Class
MOOC List is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Related Courses

Computing in Python I: Fundamentals and Procedural Programming (edX) EdX
Georgia Institute of Technology,GTx

Computing in Python I: Fundamentals and Procedural Programming (edX)

CS: Programming

Learn the fundamentals of computing in Python, including variables, operators, and writing and debugging your own programs. This course starts from the beginning, covering the basics of how a computer interprets lines of code; how to write programs, evaluate their output, and revise the code itself; how to work with variables and their changing values; and how to use mathematical, boolean, and relational operators.

Self Paced
Self-Paced
Programming Python Computing
Details
Python Basics for Data Science (edX) EdX
IBM

Python Basics for Data Science (edX)

Statistics & Data Analysis CS: Programming

This Python course provides a beginner-friendly introduction to Python for Data Science. Practice through lab exercises, and you'll be ready to create your first Python scripts on your own! Kickstart your learning of Python for data science, as well as programming in general with this introduction to Python course. This beginner-friendly Python course will quickly take you from zero to programming in Python in a matter of hours and give you a taste of how to start working with data in Python.

Self Paced
Self-Paced
Python Data Science Python Programming
Details
CS50's Introduction to Artificial Intelligence with Python (edX) EdX
HarvardX,Harvard University

CS50's Introduction to Artificial Intelligence with Python (edX)

Robotics & Computer Vision

Learn to use machine learning in Python in this introductory course on artificial intelligence. AI is transforming how we live, work, and play. By enabling new technologies like self-driving cars and recommendation systems or improving old ones like medical diagnostics and search engines, the demand for expertise in AI and machine learning is growing rapidly. This course will enable you to take the first step toward solving important real-world problems and future-proofing your career.

Self Paced
Self-Paced
Python Artificial Intelligence Machine Learning
Details
Using Python for Research (edX) EdX
HarvardX,Harvard University

Using Python for Research (edX)

CS: Software Engineering CS: Programming

Take your introductory knowledge of Python programming to the next level and learn how to use Python 3 for your research. This course bridges the gap between introductory and advanced courses in Python. While there are many excellent introductory Python courses available, most typically do not go deep enough for you to apply your Python skills to research projects.

Self Paced
Self-Paced
Programming Python Python Programming
Details
Probability and Statistics in Data Science using Python (edX) EdX
University of California, San Diego,UC San DiegoX

Probability and Statistics in Data Science using Python (edX)

Statistics & Data Analysis CS: Programming

Using Python, learn statistical and probabilistic approaches to understand and gain insights from data. The job of a data scientist is to glean knowledge from complex and noisy datasets. Reasoning about uncertainty is inherent in the analysis of noisy data. Probability and Statistics provide the mathematical foundation for such reasoning.

Self Paced
Self-Paced
Programming Python Statistics
Details
CS50's Introduction to Computer Science (edX) EdX
HarvardX,Harvard University

CS50's Introduction to Computer Science (edX)

CS: Programming Computer Science

An introduction to the intellectual enterprises of computer science and the art of programming. This is CS50, Harvard University's introduction to the intellectual enterprises of computer science and the art of programming for majors and non-majors alike, with or without prior programming experience. An entry-level course taught by David J. Malan, CS50 teaches students how to think algorithmically and solve problems efficiently.

Self Paced
Self-Paced
Programming Python C
Details
CS50's Introduction to Programming with Python (edX) EdX
HarvardX,Harvard University

CS50's Introduction to Programming with Python (edX)

CS: Programming

An introduction to programming using Python, a popular language for general-purpose programming, data science, web programming, and more. An introduction to programming using a language called Python. Learn how to read and write code as well as how to test and "debug" it. Designed for students with and without prior programming experience who'd like to learn Python specifically.

Self Paced
Self-Paced
Programming Python Python Programming
Details
Computing in Python II: Control Structures (edX) EdX
Georgia Institute of Technology,GTx

Computing in Python II: Control Structures (edX)

CS: Programming

Learn about control structures, one of the most powerful parts of programming. This course covers conditionals, loops, functions, and error handling, specifically in Python but with broader applicability to other languages as well. Building on your prior knowledge of variables and operators, this course gets into the meat of programming. Organized into five chapters, this course starts by covering the fundamentals of what control structures are and what they do, then moves on to four common control structures in Python.

Self Paced
Self-Paced
Python Computing Functions
Details
Full Stack Application Development Project (edX) EdX
IBM

Full Stack Application Development Project (edX)

Computer Science

For this project you will apply your knowledge of front end and back end development gained from previous courses and build and deploy a full stack real-world web application on the cloud. Your project will showcase your understanding of the user experience and user interface design process, and your skills and technologies with Django, Python, Node.JS and Containers.

Self Paced
Self-Paced
Python Javascript UX
Details