Linear Algebra: Orthogonality and Diagonalization (Coursera)

Linear Algebra: Orthogonality and Diagonalization (Coursera)

This is the third and final course in the Linear Algebra Specialization that focuses on the theory and computations that arise from working with orthogonal vectors. This includes the study of orthogonal transformation, orthogonal bases, and orthogonal transformations. The course culminates in the theory of symmetric matrices, linking the algebraic properties with their corresponding geometric equivalences. These matrices arise more often in applications than any other class of matrices.

Class Deals by MOOC List - Click here and see Coursera's Active Discounts, Deals, and Promo Codes.

The theory, skills and techniques learned in this course have applications to AI and machine learning. In these popular fields, often the driving engine behind the systems that are interpreting, training, and using external data is exactly the matrix analysis arising from the content in this course.
Successful completion of this specialization will prepare students to take advanced courses in data science, AI, and mathematics.
This course is part of the Linear Algebra from Elementary to Advanced Specialization.

Syllabus

Orthogonality
In this module, we define a new operation on vectors called the dot product. This operation is a function that returns a scalar related to the angle between the vectors, distance between vectors, and length of vectors. After working through the theory and examples, we hone in on both unit (length one) and orthogonal (perpendicular) vectors. These special vectors will be pivotal in our course as we start to define linear transformations and special matrices that use only these vectors.

Orthogonal Projections and Least Squares Problems
In this module we will study the special type of transformation called the orthogonal projection. We have already seen the formula for the orthogonal projection onto a line so now we generalize the formula to the case of projection onto any subspace W. The formula will require basis vectors that are both orthogonal and normalize and we show, using the Gram-Schmidt Process, how to meet these requirements given any non-empty basis.

Symmetric Matrices and Quadratic Forms
In this module we look to diagonalize symmetric matrices. The symmetry displayed in the matrix A turns out to force a beautiful relationship between the eigenspaces. The corresponding eigenspaces turn out to be mutually orthogonal. After normalizing, these orthogonal eigenvectors give a very special basis of R^n with extremely useful applications to data science, machine learning, and image processing. We introduce the notion of quadratic forms, special functions of degree two on vectors , which use symmetric matrices in their definition. Quadratic forms are then completely classified based on the properties of their eigenvalues.

Final Assessment

Go to Class
MOOC List is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Related Courses

Linear Algebra I: Vectors and Linear Equations (edX) EdX
Delft University of Technology,DelftX

Linear Algebra I: Vectors and Linear Equations (edX)

This course provides an overview of bachelor-level linear algebra. You will review all the concepts and practice and refresh the skills related to vectors and linear equations. A strong foundation in mathematics is critical for success in all science and engineering disciplines. Whether you want to make a strong start to a master’s degree, prepare for more advanced courses, solidify your knowledge in a professional context or simply brush up on fundamentals, this course will get you up to speed.

Self Paced
Self-Paced
Introduction to Linear Models and Matrix Algebra (edX) EdX
HarvardX,Harvard University

Introduction to Linear Models and Matrix Algebra (edX)

Learn to use R programming to apply linear models to analyze data in life sciences. Matrix Algebra underlies many of the current tools for experimental design and the analysis of high-dimensional data. In this introductory data analysis course, we will use matrix algebra to represent the linear models that commonly used to model differences between experimental units. We perform statistical inference on these differences. Throughout the course we will use the R programming language.

Self Paced
Self-Paced
Introduction to Linear Algebra and Python (Coursera) Coursera
Howard University

Introduction to Linear Algebra and Python (Coursera)

This course is the first of a series that is designed for beginners who want to learn how to apply basic data science concepts to real-world problems. You might be a student who is considering pursuing a career in data science and wanting to learn more, or you might be a business professional who wants to apply some data science principles to your work. Or, you might simply be a curious, lifelong learner intrigued by the powerful tools that data science and math provides. Regardless of your motivation, we’ll provide you with the support and information you need to get started.

Aug 31st 2026
4 Weeks
Essential Linear Algebra for Data Science (Coursera) Coursera
University of Colorado Boulder

Essential Linear Algebra for Data Science (Coursera)

Are you interested in Data Science but lack the math background for it? Has math always been a tough subject that you tend to avoid? This course will teach you the most fundamental Linear Algebra that you will need for a career in Data Science without a ton of unnecessary proofs and concepts that you may never use. Consider this an expressway to Data Science with approachable methods and friendly concepts that will guide you to truly understanding the most important ideas in Linear Algebra.

Aug 31st 2026
5-12 Weeks
Generalized Linear Models and Nonparametric Regression (Coursera) Coursera
University of Colorado Boulder

Generalized Linear Models and Nonparametric Regression (Coursera)

In the final course of the statistical modeling for data science program, learners will study a broad set of more advanced statistical modeling tools. Such tools will include generalized linear models (GLMs), which will provide an introduction to classification (through logistic regression); nonparametric modeling, including kernel estimators, smoothing splines; and semi-parametric generalized additive models (GAMs). Emphasis will be placed on a firm conceptual understanding of these tools.

Aug 31st 2026
4 Weeks
Advanced Machine Learning and Signal Processing (Coursera) Coursera
IBM

Advanced Machine Learning and Signal Processing (Coursera)

This course, Advanced Machine Learning and Signal Processing, is part of the IBM Advanced Data Science Specialization which IBM is currently creating and gives you easy access to the invaluable insights into Supervised and Unsupervised Machine Learning Models used by experts in many field relevant disciplines. We’ll learn about the fundamentals of Linear Algebra to understand how machine learning modes work.

Aug 12th 2024
4 Weeks
Advanced Linear Models for Data Science 1: Least Squares (Coursera) Coursera
Johns Hopkins University

Advanced Linear Models for Data Science 1: Least Squares (Coursera)

Welcome to the Advanced Linear Models for Data Science Class 1: Least Squares. This class is an introduction to least squares from a linear algebraic and mathematical perspective. Before beginning the class make sure that you have the following: a basic understanding of linear algebra and multivariate calculus; a basic understanding of statistics and regression models; at least a little familiarity with proof based mathematics; basic knowledge of the R programming language.

Sep 21st 2026
5-12 Weeks
Deep Learning and Reinforcement Learning (Coursera) Coursera
IBM

Deep Learning and Reinforcement Learning (Coursera)

This course introduces you to two of the most sought-after disciplines in Machine Learning: Deep Learning and Reinforcement Learning. Deep Learning is a subset of Machine Learning that has applications in both Supervised and Unsupervised Learning, and is frequently used to power most of the AI applications that we use on a daily basis. First you will learn about the theory behind Neural Networks, which are the basis of Deep Learning, as well as several modern architectures of Deep Learning.

Aug 31st 2026
5-12 Weeks