Coursera

Information Theory (Coursera)

Offered by The Chinese University of Hong Kong,

At the completion of this course, the student should be able to: demonstrate knowledge and understanding of the fundamentals of information theory; appreciate the notion of fundamental limits in communication systems and more generally all systems; develop deeper understanding of communication systems; apply the concepts of information theory to various disciplines in information science.

Class Deals by MOOC List - Click here and see Coursera's Active Discounts, Deals, and Promo Codes.

The lectures of this course are based on the first 11 chapters of Prof. Raymond Yeung’s textbook entitled Information Theory and Network Coding (Springer 2008). This book and its predecessor, A First Course in Information Theory (Kluwer 2002, essentially the first edition of the 2008 book), have been adopted by over 60 universities around the world as either a textbook or reference text.

Syllabus

WEEK 1: Course Preliminaries
WEEK 2: Chapter 2 Information Measures - Part 2
WEEK 3: Chapter 3 The I-Measure - Part 1
WEEK 4: Chapter 3 The I-Measure - Part 2, Chapter 4 Zero-Error Data Compression - Part 1
WEEK 5: Chapter 4 Zero-Error Data Compression - Part 2, Chapter 5 Weak Typicality
WEEK 6: Chapter 6 Strong Typicality
WEEK 7: Chapter 7 Discrete Memoryless Channels - Part 1
WEEK 8: Chapter 7 Discrete Memoryless Channels - Part 2
WEEK 9: Chapter 8 Rate-Distortion Theory - Part 1
WEEK 10: Chapter 8 Rate-Distortion Theory - Part 2, Chapter 9 The Blahut-Arimoto Algorithms - Part 1
WEEK 11: Chapter 9 The Blahut-Arimoto Algorithms - Part 2, Chapter 10 Differential Entropy - Part 1
WEEK 12: Chapter 10 Differential Entropy - Part 2
WEEK 13: Chapter 11 Continuous-Valued Channels - Part 1
WEEK 14: Chapter 11 Continuous-Valued Channels - Part 2
WEEK 15: Chapter 11 Continuous-Valued Channels - Part 3

Go to Class

MOOC List is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Related Courses

Coursera

University of California, San Diego

Data Structures and Performance (Coursera)

CS: Theory Data Science

How do Java programs deal with vast quantities of data? Many of the data structures and algorithms that work with introductory toy examples break when applications process real, large data sets. Efficiency is critical, but how do we achieve it, and how do we even measure it? This is an intermediate Java course. We recommend this course to learners who have previous experience in software development or a background in computer science, and in particular, we recommend that you have taken the first course in this specialization (which also requires some previous experience with Java).

Jun 29th 2026

5-12 Weeks

Programming Java Algorithms

Coursera

University of California, San Diego,Higher School of Economics - HSE University

Combinatorics and Probability (Coursera)

CS: Theory Sci: Mathematics

Counting is one of the basic mathematically related tasks we encounter on a day to day basis. The main question here is the following. If we need to count something, can we do anything better than just counting all objects one by one? Do we need to create a list of all phone numbers to ensure that there are enough phone numbers for everyone? Is there a way to tell that our algorithm will run in a reasonable time before implementing and actually running it? All these questions are addressed by a mathematical field called Combinatorics.

Jun 29th 2026

5-12 Weeks

Probability Combinatorics Algorithms

Coursera

University of Minnesota

Nearest Neighbor Collaborative Filtering (Coursera)

Data Science

In this course, you will learn the fundamental techniques for making personalized recommendations through nearest-neighbor techniques. First you will learn user-user collaborative filtering, an algorithm that identifies other people with similar tastes to a target user and combines their ratings to make recommendations for that user.

Jun 29th 2026

4 Weeks

Algorithms Machine Learning Data Science

Coursera

University of California, San Diego,Higher School of Economics - HSE University

What is a Proof? (Coursera)

CS: Software Engineering CS: Theory

Mathematical thinking is crucial in all areas of computer science: algorithms, bioinformatics, computer graphics, data science, machine learning, etc. In this course, we will learn the most important tools used in discrete mathematics: induction, recursion, logic, invariants, examples, optimality. We will use these tools to answer typical programming questions like: How can we be certain a solution exists? Am I sure my program computes the optimal answer? Do each of these objects meet the given requirements?

Jun 29th 2026

5-12 Weeks

Math Programming Algorithms

Coursera

Johns Hopkins University

Practical Machine Learning (Coursera)

Statistics & Data Analysis Data Science

One of the most common tasks performed by data scientists and data analysts are prediction and machine learning. This course will cover the basic components of building and applying prediction functions with an emphasis on practical applications. The course will provide basic grounding in concepts such as training and tests sets, overfitting, and error rates.

Jun 29th 2026

4 Weeks

Algorithms Machine Learning Regression

Coursera

EIT Digital

Development of Real-Time Systems (Coursera)

CS: Software Engineering

This course is intended for the Master's student and computer engineer who likes practical programming and problem solving! After completing this course, you will have the knowledge to plan and set-up a real-time system both on paper and in practice. The course centers around the problem of achieving timing correctness in embedded systems, which means to guarantee that the system reacts within the real-time requirements.

Jun 29th 2026

5-12 Weeks

Programming Computing Algorithms

Coursera

Universidad Nacional Autónoma de México

Álgebra Básica (Coursera)

Sci: Mathematics

Galileo dijo: "El Universo está escrito en lenguaje matemático y los caracteres son triángulos, círculos y otras figuras geométricas, sin las que es humanamente imposible entender una sola palabra". Para entender el Universo, es necesario plantear leyes que expliquen su comportamiento, como pueden ser las leyes de la gravedad, la propagación del calor, el electromagnetismo, la reproducción celular, el crecimiento poblacional, la propagación de las enfermedades, la variación de los precios de las acciones en la bolsa de valores, el comportamiento de las masas ante un conflicto, etcétera.

Jun 29th 2026

5-12 Weeks

Math Algebra Mathematics

Coursera

Duke University

Programming Fundamentals (Coursera)

CS: Theory CS: Programming

Programming is an increasingly important skill, whether you aspire to a career in software development, or in other fields. This course is the first in the specialization Introduction to Programming in C, but its lessons extend to any language you might want to learn. This is because programming is fundamentally about figuring out how to solve a class of problems and writing the algorithm, a clear set of steps to solve any problem in its class.

Jun 29th 2026

4 Weeks

Programming Algorithms C Language

Coursera

University of California, San Diego,Higher School of Economics - HSE University

Algorithms on Graphs (Coursera)

CS: Software Engineering CS: Theory

If you have ever used a navigation service to find optimal route and estimate time to destination, you've used algorithms on graphs. Graphs arise in various real-world situations as there are road networks, computer networks and, most recently, social networks! If you're looking for the fastest time to get to work, cheapest way to connect set of computers into a network or efficient algorithm to automatically find communities and opinion leaders in Facebook, you're going to work with graphs and algorithms on graphs.

Jun 29th 2026

5-12 Weeks

Algorithms Data Structures Graphs

Coursera

University of Washington

Machine Learning: Regression (Coursera)

Statistics & Data Analysis Data Science

Case Study - Predicting Housing Prices. In our first case study, predicting house prices, you will create models that predict a continuous value (price) from input features (square footage, number of bedrooms and bathrooms,...). This is just one of the many places where regression can be applied. Other applications range from predicting health outcomes in medicine, stock prices in finance, and power usage in high-performance computing, to analyzing which regulators are important for gene expression.

Jun 29th 2026

5-12 Weeks

Python Algorithms Machine Learning

Coursera

University of Illinois at Urbana-Champaign

VLSI CAD Part II: Layout (Coursera)

CS: Software Engineering CS: Theory

A modern VLSI chip is a remarkably complex beast: billions of transistors, millions of logic gates deployed for computation and control, big blocks of memory, embedded blocks of pre-designed functions designed by third parties (called “intellectual property” or IP blocks). How do people manage to design these complicated chips? Answer: a sequence of computer aided design (CAD) tools takes an abstract description of the chip, and refines it step-wise to a final design.

Jun 29th 2026

5-12 Weeks

Programming Algorithms ASIC

Coursera

University of Michigan

Introduction to HTML5 (Coursera)

CS: Programming

Thanks to a growing number of software programs, it seems as if anyone can make a webpage. But what if you actually want to understand how the page was created? There are great textbooks and online resources for learning web design, but most of those resources require some background knowledge. This course is designed to help the novice who wants to gain confidence and knowledge. We will explore the theory (what actually happens when you click on a link on a webpage?), the practical (what do I need to know to make my own page?), and the overlooked (I have a page, what do I do now?).

Jun 29th 2026

3 Weeks

Programming HTML HTML5