Linear Algebra: Orthogonality and Diagonalization (Coursera)

Linear Algebra: Orthogonality and Diagonalization (Coursera)

This is the third and final course in the Linear Algebra Specialization that focuses on the theory and computations that arise from working with orthogonal vectors. This includes the study of orthogonal transformation, orthogonal bases, and orthogonal transformations. The course culminates in the theory of symmetric matrices, linking the algebraic properties with their corresponding geometric equivalences. These matrices arise more often in applications than any other class of matrices.

Class Deals by MOOC List - Click here and see Coursera's Active Discounts, Deals, and Promo Codes.

The theory, skills and techniques learned in this course have applications to AI and machine learning. In these popular fields, often the driving engine behind the systems that are interpreting, training, and using external data is exactly the matrix analysis arising from the content in this course.
Successful completion of this specialization will prepare students to take advanced courses in data science, AI, and mathematics.
This course is part of the Linear Algebra from Elementary to Advanced Specialization.

Syllabus

Orthogonality
In this module, we define a new operation on vectors called the dot product. This operation is a function that returns a scalar related to the angle between the vectors, distance between vectors, and length of vectors. After working through the theory and examples, we hone in on both unit (length one) and orthogonal (perpendicular) vectors. These special vectors will be pivotal in our course as we start to define linear transformations and special matrices that use only these vectors.

Orthogonal Projections and Least Squares Problems
In this module we will study the special type of transformation called the orthogonal projection. We have already seen the formula for the orthogonal projection onto a line so now we generalize the formula to the case of projection onto any subspace W. The formula will require basis vectors that are both orthogonal and normalize and we show, using the Gram-Schmidt Process, how to meet these requirements given any non-empty basis.

Symmetric Matrices and Quadratic Forms
In this module we look to diagonalize symmetric matrices. The symmetry displayed in the matrix A turns out to force a beautiful relationship between the eigenspaces. The corresponding eigenspaces turn out to be mutually orthogonal. After normalizing, these orthogonal eigenvectors give a very special basis of R^n with extremely useful applications to data science, machine learning, and image processing. We introduce the notion of quadratic forms, special functions of degree two on vectors , which use symmetric matrices in their definition. Quadratic forms are then completely classified based on the properties of their eigenvalues.

Final Assessment

Go to Class
MOOC List is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Related Courses

First Steps in Linear Algebra for Machine Learning (Coursera) Coursera
Higher School of Economics - HSE University

First Steps in Linear Algebra for Machine Learning (Coursera)

The main goal of the course is to explain the main concepts of linear algebra that are used in data analysis and machine learning. Another goal is to improve the student’s practical skills of using linear algebra methods in machine learning and data analysis. You will learn the fundamentals of working with data in vector and matrix form, acquire skills for solving systems of linear algebraic equations and finding the basic matrix decompositions and general understanding of their applicability.

May 9th 2022
4 Weeks
Introduction to Linear Algebra and Python (Coursera) Coursera
Howard University

Introduction to Linear Algebra and Python (Coursera)

This course is the first of a series that is designed for beginners who want to learn how to apply basic data science concepts to real-world problems. You might be a student who is considering pursuing a career in data science and wanting to learn more, or you might be a business professional who wants to apply some data science principles to your work. Or, you might simply be a curious, lifelong learner intrigued by the powerful tools that data science and math provides. Regardless of your motivation, we’ll provide you with the support and information you need to get started.

Aug 31st 2026
4 Weeks
Linear Algebra I: Vectors and Linear Equations (edX) EdX
Delft University of Technology,DelftX

Linear Algebra I: Vectors and Linear Equations (edX)

This course provides an overview of bachelor-level linear algebra. You will review all the concepts and practice and refresh the skills related to vectors and linear equations. A strong foundation in mathematics is critical for success in all science and engineering disciplines. Whether you want to make a strong start to a master’s degree, prepare for more advanced courses, solidify your knowledge in a professional context or simply brush up on fundamentals, this course will get you up to speed.

Self Paced
Self-Paced
Linear Algebra for Machine Learning and Data Science (Coursera) Coursera
DeepLearning.AI

Linear Algebra for Machine Learning and Data Science (Coursera)

After completing this course, learners will be able to: represent data as vectors and matrices and identify their properties using concepts of singularity, rank, and linear independence, etc.; apply common vector and matrix algebra operations like dot product, inverse, and determinants; express certain types of matrix operations as linear transformations; apply concepts of eigenvalues and eigenvectors to machine learning problems.

Sep 7th 2026
4 Weeks
Mathematics for Machine Learning: Linear Algebra (Coursera) Coursera
Imperial College London

Mathematics for Machine Learning: Linear Algebra (Coursera)

In this course on Linear Algebra we look at what linear algebra is and how it relates to vectors and matrices. Then we look through what vectors and matrices are and how to work with them, including the knotty problem of eigenvalues and eigenvectors, and how to use these to solve problems. Finally we look at how to use these to do fun things with datasets - like how to rotate images of faces and how to extract eigenvectors to look at how the Pagerank algorithm works.

Sep 7th 2026
5-12 Weeks
Algorithms with Numbers (Coursera) Coursera
Saint Petersburg State University

Algorithms with Numbers (Coursera)

This course represents an introduction to algorithms with numbers, including linear algebra problems and arbitrary precision arithmetic, that appear virtually everywhere, from cryptography to audio processing. You will learn how to: implement the basic number theory algorithms like Euclidean algorithm that are basic building blocks for modern cryptography; work with large numbers arising in cryptography and high precision arithmetic; solve systems of linear equations that appear in many areas from designing electrical circuits to computer graphics; implement Fast Fourier Transform that is inevitable in signal processing. Each module includes a programming assignment that will improve both your understanding of the topics and your programming skills.

May 16th 2022
4 Weeks
Advanced Linear Models for Data Science 1: Least Squares (Coursera) Coursera
Johns Hopkins University

Advanced Linear Models for Data Science 1: Least Squares (Coursera)

Welcome to the Advanced Linear Models for Data Science Class 1: Least Squares. This class is an introduction to least squares from a linear algebraic and mathematical perspective. Before beginning the class make sure that you have the following: a basic understanding of linear algebra and multivariate calculus; a basic understanding of statistics and regression models; at least a little familiarity with proof based mathematics; basic knowledge of the R programming language.

Sep 21st 2026
5-12 Weeks
Matrix Algebra for Engineers (Coursera) Coursera
The Hong Kong University of Science and Technology - HKUST

Matrix Algebra for Engineers (Coursera)

This course is all about matrices, and concisely covers the linear algebra that an engineer should know. The mathematics in this course is presented at the level of an advanced high school student, but typically students should take this course after completing a university-level single variable calculus course. There are no derivatives or integrals in this course, but students are expected to have attained a sufficient level of mathematical maturity. Nevertheless, anyone who wants to learn the basics of matrix algebra is welcome to join.

Aug 31st 2026
4 Weeks