EdX

Introduction to Designing Data Lakes on AWS (edX)

Offered by AWS,

In this class, we will help you understand how to create and operate a data lake in a secure and scalable way, without previous knowledge of data science! Designing a data lake is challenging because of the scale and growth of data. This course is for professionals (Architects, System Administrators and DevOps) who need to design and build an architecture for secure and scalable Data Lake components. Students will learn about the use cases for a Data Lake and, contrast that with a traditional infrastructure of servers and storage.

Class Deals by MOOC List - Click here and see EdX's Active Discounts, Deals, and Promo Codes.

Developers need to understand best practices to avoid common mistakes that could be hard to rectify. In this course we will cover the foundations of what a Data Lake is, how to ingest and organize data into the Data Lake, and dive into the data processing that can be done to optimize performance and costs when consuming the data at scale.
This course is part of the Cloud Solutions Architecture Professional Certificate.

What you'll learn

Where to start with a Data Lake?
How to build a secure and scalable Data Lake?
What are the common components of a Data Lake?
Why do you need a Data Lake and what it's value?

Syllabus

Week 1: Hello World, I mean, Hello Data Lakes!
Video: Meet the Instructors
Video: Introduction to Week 1
Video: Why Data Lakes?
Video: Characteristics of a Data Lake
Video: Data Lake Components
Reading: Data Lake Characteristics and Components
Video: Comparison of a Data Lake to a Data Warehouse
Reading: Data Lakes and Data Warehouses
Video: Discussing sample Data Lake Architectures
Quiz/Assessment: Week 1 quiz

Week 2: AWS data related services
Video: Introduction to Week 2
Video: AWS Data Lake related services
Video: Amazon S3
Video: AWS Glue Data Catalog
Reading: S3 and Glue Data Catalog
Video: AWS Services used for data movement
Reading: Kinesis, API Gateway, etc
Video: AWS Services for Data processing
Video: AWS Services for Analytics
Video: AWS Services used for Predictive Analytics and Machine Learning
Reading: EMR, Glue Jobs, Lambda, Kinesis Analytics, Redshift
Video: Introduction to AWS LakeFormation
Reading: LakeFormation
Lab: Get familiar with AWS Services and create your first simple data lake

Week 3: Ingesting the rivers
Video: Introduction to Week 3
Video: Use the right tool for the job
Video: Understanding Data Structure and when to process data
Video: Data Streaming ingestion with Amazon Kinesis Services
Video: Diving Deep on Amazon Kinesis
Demo: Batch Data Ingestion with AWS Transfer Family
Reading: Batch Data Ingestion with AWS Services
Video: Data Cataloging
Demo: Using Glue Crawlers
Reading: The importance of data cataloging
Video: Reviewing the ingestion part of some Data Lake architectures
Lab: Ingesting Web Logs

Week 4: Processing and Analyzing data that sits in the Data Lake
Video: Introduction to Week 4
Video: Data prep and AWS Glue jobs
Video: File optimizations
Demo: Using S3, Glue and Athena to get insights about NYC Taxi data
Reading: Glue Jobs, Data Prep, Athena? Columnar Data Formats and Amazon Athena Optimizations
Video: Introduction to Data Lake security
Reading: Security and compliance
Video: The power of data visualization
Video: Introduction to Amazon QuickSight
Demo: Amazon Quicksight
Reading: Data visualization, Amazon QuickSight
Video: Registry of Open Data on AWS
Lab: Create an end-to-end Data Lake with AWS Services
Video: Course wrap-up!

Go to Class

MOOC List is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Related Courses

Getting Started with Data Analytics on AWS (edX)

EdX

AWS

Getting Started with Data Analytics on AWS (edX)

Statistics & Data Analysis Data Science

Learn how to go from raw data to meaningful insights using AWS with this one-week course. With the explosion of data collection enabled by the internet, mobile applications and transformation into the cloud, effective data analytics is turning into a critical tool in practically every domain – from academia to enterprise.

Self Paced

Self-Paced

Predictive Analytics Descriptive Analytics Data Analytics

DevOps on AWS: Code, Build, and Test (edX)

EdX

AWS

DevOps on AWS: Code, Build, and Test (edX)

CS: Information & Technology Computer Science

Learn the basic concepts, technology, use cases, and benefits of implementing DevOps on AWS. DevOps is the combination of cultural philosophies, practices, and tools that increase an organization’s ability to deliver applications and services at high velocity: evolving and improving products at a faster pace than organizations using traditional software development and infrastructure management processes. This speed enables organizations to better serve their customers and compete more effectively in the market.

Self Paced

Self-Paced

DevOps AWS DevOps AWS

Cloud Cost Management: Optimization Strategies (edX)

EdX

AWS

Cloud Cost Management: Optimization Strategies (edX)

CS: Information & Technology Computer Science

Cloud cost management is the organizational planning that allows an enterprise to understand and manage the costs and needs associated with its cloud technology. In particular, this means finding cost-effective ways to maximize cloud usage and efficiency. AWS has a set of services, tools and resources to help the customers with cost management and optimization. This course will highlight the solutions and best practices to get started with optimizing AWS cost and capacity.

Self Paced

Self-Paced

Cloud Cost Management AWS

Leading Digital and Data Decision Making (edX)

EdX

Arizona State University,ASUx

Leading Digital and Data Decision Making (edX)

Business

In this course, you will learn how leaders make managerial and relevant decisions based on data across multiple global industries. You will also explore how companies benefit from a digital ecosystem including sensors (IoT), Blockchain, artificial intelligence (AI), and augmented reality (AR) that move data-driven insights from the data scientist to the boardroom.

This course is archived

5-12 Weeks

Data Artificial Intelligence Digital

Hands-on with AWS for IT Professionals (edX)

EdX

AWS

Hands-on with AWS for IT Professionals (edX)

CS: Information & Technology Computer Science

Get hands-on with AWS and build a solution that addresses a common data, operations, and architecture scenario. This course gets hands-on by teaching how to create a new AWS Account, create an Administrative User, and explore the AWS Free Tier. Students can then follow demonstration and explainer videos containing on how AWS Services can combine to create solutions that can be useful in real-life scenarios.

Self Paced

Self-Paced

AWS AWS Services AWS Cloud

Introduction to AWS Identity and Access Management (edX)

EdX

AWS

Introduction to AWS Identity and Access Management (edX)

Security & Networking

This course will focus on one of the key security services, AWS Identity and Access Management (IAM). It is meant to provide learners with an introduction to and some deeper level content on AWS IAM. Security should be your first priority when developing cloud native applications. The goal of this course is to provide you with foundational knowledge and skills that will enable you to grow in your use of both AWS IAM and the rest of the AWS ecosystem.

Self Paced

Self-Paced

AWS AWS Identity and Access Management AWS IAM

Making Evidence-Based Strategic Decisions (edX)

EdX

University of Maryland, College Park,University System of Maryland - USM,USMx,UMD

Making Evidence-Based Strategic Decisions (edX)

Statistics & Data Analysis

Drive alignment among managers, employees and the organizational goals through data analytics and data products. This course on digital transformation will show you how to turn your organization into a decision-making factory. What makes a good business decision? How can we combine effective data analytics and feed robust foresight and scenario planning processes?

Self Paced

Self-Paced

Artificial Intelligence Decision Making Data Products

EdX

IBM

Data Warehousing and BI Analytics (edX)

Engineering

This course introduces you to designing, implementing and populating a data warehouse and analyzing its data using SQL & Business Intelligence (BI) tools. Today’s businesses are investing significantly in capabilities to harness the massive amounts of data that fuel Business Intelligence (BI). Working knowledge of Data Warehouses and BI Analytics tools are a crucial skill for Data Engineers, Data Warehousing Specialists and BI Analysts, making who are amongst, the most valued resources for organizations.

Self Paced

Self-Paced

SQL Analytics Business Intelligence

Data Analytics and Visualization in Health Care (edX)

EdX

Rochester Institute of Technology,RITx

Data Analytics and Visualization in Health Care (edX)

Health & Society Statistics & Data Analysis

Learn best practices in data analytics, informatics, and visualization to gain literacy in data-driven, strategic imperatives that affect all facets of health care. Big data is transforming the health care industry relative to improving quality of care and reducing costs—key objectives for most organizations. Employers are desperately searching for professionals who have the ability to extract, analyze, and interpret data from patient health records, insurance claims, financial records, and more to tell a compelling and actionable story using health care data analytics.

Self Paced

Self-Paced

Healthcare Artificial Intelligence Informatics

Data Analytics in Accounting and Finance (edX)

EdX

The Hong Kong Polytechnic University,HKPolyUx

Data Analytics in Accounting and Finance (edX)

Statistics & Data Analysis

Understand key concepts in the data analytics process, along with the practical application of data sets in the accounting and finance context. This data analytics course takes an interdisciplinary approach to describe the data analytics process in the context of accounting and finance. The growing volume of both structured and unstructured data has pushed forward a more data-driven form of decision making in accounting and finance. To get along with the advancements, accountants and finance professionals need to have an analytics mindset to excel in their jobs.

Self Paced

Self-Paced

Finance Hypothesis Excel

Effecting Digital Transformation with Data Analytics Projects (edX)

EdX

University of Maryland, College Park,University System of Maryland - USM,USMx,UMD

Effecting Digital Transformation with Data Analytics Projects (edX)

Statistics & Data Analysis Business

Learn how to transform an organization digitally through simulations and case studies by applying the Disciplined Agile Delivery framework to work through three simulations. As a business leader, you may be asking yourself, what’s next? R? Python? Graph Databases? The latest data analytics technology that was launched last week? How do you craft an effective digital strategy from these technologies? How do you build the data transformation roadmap to give your organization a competitive advantage? How will you digitally transform your organization to give the best customer experience? In this course, we will explore three case studies to learn the practical tools and methods used to build a digital organization.

Self Paced

Self-Paced

Digital Transformation Data Analytics Transforming Your Company’s Data Analytics: Championing the Digital Enterprise Professional Certificate

Data Analytics in Health - From Basics to Business (edX)

EdX

KU Leuven University

Data Analytics in Health - From Basics to Business (edX)

Health & Society Medicine & Pharmacology

Improve diagnostics, care and curing by effectively applying data analytics in healthcare and spot entrepreneurial opportunities. Many people talk about the promise of “big data” to health care. But how can the application of data analytics to big data actually improve health and health care? We will show that novel data analytics based solutions can result in better diagnosis, better care and better curing. This provides fertile ground for entrepreneurship and the development of new businesses.

No session available

4 Weeks

Health Healthcare Entrepreneurship