Udacity

Real-Time Analytics with Apache Storm (Udacity)

Offered by Udacity, Twitter,
Real-Time Analytics with Apache Storm (Udacity)

The world is trending in real time! Learn from Twitter to scalably process tweets, or any big data stream, in real-time to drive d3 visualizations using Apache Storm, the "Hadoop of Real Time." Storm is free, open source, and fun to use! Learn from Karthik Ramasamy, about the distributed, fault-tolerant, and flexible technology used to power Twitter’s real-time data flow pipeline. Twitter open sourced Storm in 2011, and it graduated to a top-level Apache project in September, 2014.

Class Deals by MOOC List - Click here and see Udacity's Active Discounts, Deals, and Promo Codes.

Starting from basic distributed concepts presented during our first Udacity-Twitter Storm Hackathon, link Storm concepts to Storm syntax to scalably drive Word Cloud visualizations with Vagrant, Ubuntu, Maven, Flask, Redis, and d3. Link to the public Twitter gardenhose stream to process live tweets, parse embedded URLs, and calculate Top worldwide hashtags. Extend beyond Storm basics by exploring multi-language capabilities in Python, integrate open source components, and implement real-time streaming joins.
In your final project, follow real-time trending topics by implementing the data pipeline to visualize only tweets that contain Top worldwide hashtags. Extend your project by exploring the Twitter API, or any data source, alongside Hackathon participants as they design their own ideas, receive feedback from Karthik, and open source a final project calculating real-time tweet sentiment and geolocation to drive a U.S. Map.
Learn by doing! The world is going real time. Batch processing, popularized by Hadoop, has latency exceeding required real-time demands of modern mobile, connected, always-on users. Stream processing with seconds-required response time is necessary to meet this demand. Twitter is a world leader in real-time processing at scale. Learn the future from the company defining it.

What You Will Learn

Lesson 1
Basic Storm Topologies

  • Link to a real-time d3 Word Cloud Visualization using Redis Flask and d3

Lesson 2
Storm Basics

  • Program Bolts link Spouts and connect to the live Twitter API to process real-time tweets
  • Explore open source components by connecting a Rolling Count Bolt to your topology to visualize Rolling Top Tweeted Words

Lesson 3
Beyond Storm Basics

  • Explore multi-language capabilities to download and parse real-time Tweeted URLs in Python using Beautiful Soup
  • Integrate complex open source bolts to calculate Top-N words to visualize real-time Top-N Hashtags
  • Use stream grouping concepts to easily create streaming join to connect and dynamically process multiple streams

Lesson 4
Final Project

  • Work on your final project and we cover additional questions and topics brought up by Hackathon participants
  • Explore Vagrant
  • VirtualBox
  • Redis
  • Flask
  • and d3 further if you are interested!

Lesson 5
Final Project: Construct a Storm Topology

  • Design a Storm Topology and new bolt that uses streaming joins to dynamically calculate Top-N Hashtags and display real-time tweets that contain trending Top Hashtags
  • Post your visualization to the forum and tweet them to your Twitter followers

Lesson 6
Project Extensions

  • Use additional features of the real-time Twitter sample stream or use any data source to drive your real-time d3 visualization

Prerequisites and Requirements
Programming language required: JavaTo be successful, you'll need intermediate knowledge of Java. Specifically, this is defined by experience and comfort with Java syntax, compile & run-time error diagnostics and debugging, ability to use javadocs as needed, and intermediate data structures including Arrays, HashMaps, and LinkedLists. If you need to build these skills, a good starting point is Udacity’s Introduction to Java with additional comfortability needed identifying and debugging compile & run-time errors. No prior experience is assumed in Ubuntu, git, Maven, Redis, Flask (Python) or d3 (Javascript). Python is useful, but optional. A basic course such as CS101 or OO in Python would be helpful.

Go to Class
MOOC List is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Related Courses

Code Free Data Science (Coursera) Coursera
University of California, San Diego

Code Free Data Science (Coursera)

Data Science

The Code Free Data Science class is designed for learners seeking to gain or expand their knowledge in the area of Data Science. Participants will receive the basic training in effective predictive analytic approaches accompanying the growing discipline of Data Science without any programming requirements. Machine Learning methods will be presented by utilizing the KNIME Analytics Platform to discover patterns and relationships in data.

Sep 28th 2026
4 Weeks
Machine Learning Big Data Data Science
Details
Global Statistics - Composite Indices for International Comparisons (Coursera) Coursera
University of Geneva

Global Statistics - Composite Indices for International Comparisons (Coursera)

Statistics & Data Analysis Data Science

In this course on global statistics, offered by the University of Geneva jointly with the ETH Zürich KOF, you will learn the general approach of constructing composite indices and some of resulting problems. We will discuss the technical properties, the internal structure (like aggregation, weighting, stability of time series), the primary data used and the variable selection methods. These concepts will be illustrated using a sample of the most popular composite indices. We will try to address not only statistical questions but also focus on the distinction between policy-, media- and paradigm-driven indicators.

Sep 28th 2026
5-12 Weeks
Statistics Data Analysis Comparison
Details
Big Data Analysis Deep Dive (Coursera) Coursera
Alibaba Cloud Academy

Big Data Analysis Deep Dive (Coursera)

CS: Information & Technology

The job market for architects, engineers, and analytics professionals with Big Data expertise continues to increase. The Academy’s Big Data Career path focuses on the fundamental tools and techniques needed to pursue a career in Big Data. This course includes: data processing with python, writing and reading SQL queries, transmitting data with MaxCompute, analyzing data with Quick BI, using Hive, Hadoop, and spark on E-MapReduce, and how to visualize data with data dashboards. Work through our course material, learn different aspects of the Big Data field, and get certified as a Big Data Professional!

Sep 28th 2026
5-12 Weeks
Python SQL Big Data
Details
Empathy, Data, and Risk (Coursera) Coursera
University of Illinois at Urbana-Champaign

Empathy, Data, and Risk (Coursera)

Business

Risk Management and Innovation develops your ability to conduct empathy-driven and data-driven analysis in the domain of risk management. This course introduces empathy as a professional competency. It explains the psychological processes that inhibit empathy-building and the processes that determine how organizational stakeholders respond to risk.

Sep 28th 2026
4 Weeks
Risk Management Data Analysis Brainstorming
Details
Responsive Images (Udacity) Udacity
Udacity,Google

Responsive Images (Udacity)

CS: Software Engineering Computer Science

Fewer Bytes, Faster Loads. Did you know that images account for more than 60% of the bytes on average needed to load a web page? In this course you will learn how to work with images on the modern web, so that your images look great and load quickly on any device. Along the way, you will pick up a range of skills and techniques to smoothly integrate responsive images into your development workflow. By the end of the course, you will be developing with images that adapt and respond to different viewport sizes and usage scenarios.

Self Paced
Self-Paced
Image Debugging Responsiveness
Details
Necessary Condition Analysis (NCA) (Coursera) Coursera
Erasmus University Rotterdam

Necessary Condition Analysis (NCA) (Coursera)

Economics & Finance

Welcome to Necessary Condition Analysis (NCA). NCA analyzes data using necessity logic. A necessary condition implies that if the condition is not in place, there will be guaranteed failure of the outcome. The opposite however is not true; if the condition is in place, success of the outcome is not guaranteed.

Sep 28th 2026
5-12 Weeks
Data Analysis Coursera Plus Necessary Condition Analysis
Details
Population Health: Predictive Analytics (Coursera) Coursera
Leiden University

Population Health: Predictive Analytics (Coursera)

Statistics & Data Analysis Data Science

Predictive analytics has a longstanding tradition in medicine. Developing better prediction models is a critical step in the pursuit of improved health care: we need these tools to guide our decision-making on preventive measures, and individualized treatments. In order to effectively use and develop these models, we must understand them better. In this course, you will learn how to make accurate prediction tools, and how to assess their validity. First, we will discuss the role of predictive analytics for prevention, diagnosis, and effectiveness. Then, we look at key concepts such as study design, sample size and overfitting.

Sep 28th 2026
4 Weeks
Health Data Analysis Predictive Analytics
Details