Linear Algebra: Orthogonality and Diagonalization (Coursera)

Linear Algebra: Orthogonality and Diagonalization (Coursera)

This is the third and final course in the Linear Algebra Specialization that focuses on the theory and computations that arise from working with orthogonal vectors. This includes the study of orthogonal transformation, orthogonal bases, and orthogonal transformations. The course culminates in the theory of symmetric matrices, linking the algebraic properties with their corresponding geometric equivalences. These matrices arise more often in applications than any other class of matrices.

Class Deals by MOOC List - Click here and see Coursera's Active Discounts, Deals, and Promo Codes.

The theory, skills and techniques learned in this course have applications to AI and machine learning. In these popular fields, often the driving engine behind the systems that are interpreting, training, and using external data is exactly the matrix analysis arising from the content in this course.
Successful completion of this specialization will prepare students to take advanced courses in data science, AI, and mathematics.
This course is part of the Linear Algebra from Elementary to Advanced Specialization.

Syllabus

Orthogonality
In this module, we define a new operation on vectors called the dot product. This operation is a function that returns a scalar related to the angle between the vectors, distance between vectors, and length of vectors. After working through the theory and examples, we hone in on both unit (length one) and orthogonal (perpendicular) vectors. These special vectors will be pivotal in our course as we start to define linear transformations and special matrices that use only these vectors.

Orthogonal Projections and Least Squares Problems
In this module we will study the special type of transformation called the orthogonal projection. We have already seen the formula for the orthogonal projection onto a line so now we generalize the formula to the case of projection onto any subspace W. The formula will require basis vectors that are both orthogonal and normalize and we show, using the Gram-Schmidt Process, how to meet these requirements given any non-empty basis.

Symmetric Matrices and Quadratic Forms
In this module we look to diagonalize symmetric matrices. The symmetry displayed in the matrix A turns out to force a beautiful relationship between the eigenspaces. The corresponding eigenspaces turn out to be mutually orthogonal. After normalizing, these orthogonal eigenvectors give a very special basis of R^n with extremely useful applications to data science, machine learning, and image processing. We introduce the notion of quadratic forms, special functions of degree two on vectors , which use symmetric matrices in their definition. Quadratic forms are then completely classified based on the properties of their eigenvalues.

Final Assessment

Go to Class
MOOC List is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Related Courses

Machine Learning (Coursera) Coursera
Stanford University

Machine Learning (Coursera)

Machine learning is the science of getting computers to act without being explicitly programmed. In the past decade, machine learning has given us self-driving cars, practical speech recognition, effective web search, and a vastly improved understanding of the human genome. Machine learning is so pervasive today that you probably use it dozens of times a day without knowing it. Many researchers also think it is the best way to make progress towards human-level AI. In this class, you will learn about the most effective machine learning techniques, and gain practice implementing them and getting them to work for yourself. More importantly, you'll learn about not only the theoretical underpinnings of learning, but also gain the practical know-how needed to quickly and powerfully apply these techniques to new problems.

Nov 16th 2026
5-12 Weeks
Introduction to Linear Models and Matrix Algebra (edX) EdX
HarvardX,Harvard University

Introduction to Linear Models and Matrix Algebra (edX)

Learn to use R programming to apply linear models to analyze data in life sciences. Matrix Algebra underlies many of the current tools for experimental design and the analysis of high-dimensional data. In this introductory data analysis course, we will use matrix algebra to represent the linear models that commonly used to model differences between experimental units. We perform statistical inference on these differences. Throughout the course we will use the R programming language.

Self Paced
Self-Paced
Linear Algebra I: Vectors and Linear Equations (edX) EdX
Delft University of Technology,DelftX

Linear Algebra I: Vectors and Linear Equations (edX)

This course provides an overview of bachelor-level linear algebra. You will review all the concepts and practice and refresh the skills related to vectors and linear equations. A strong foundation in mathematics is critical for success in all science and engineering disciplines. Whether you want to make a strong start to a master’s degree, prepare for more advanced courses, solidify your knowledge in a professional context or simply brush up on fundamentals, this course will get you up to speed.

Self Paced
Self-Paced
Mathematics for Machine Learning: Linear Algebra (Coursera) Coursera
Imperial College London

Mathematics for Machine Learning: Linear Algebra (Coursera)

In this course on Linear Algebra we look at what linear algebra is and how it relates to vectors and matrices. Then we look through what vectors and matrices are and how to work with them, including the knotty problem of eigenvalues and eigenvectors, and how to use these to solve problems. Finally we look at how to use these to do fun things with datasets - like how to rotate images of faces and how to extract eigenvectors to look at how the Pagerank algorithm works.

Nov 16th 2026
5-12 Weeks
Advanced Linear Models for Data Science 1: Least Squares (Coursera) Coursera
Johns Hopkins University

Advanced Linear Models for Data Science 1: Least Squares (Coursera)

Welcome to the Advanced Linear Models for Data Science Class 1: Least Squares. This class is an introduction to least squares from a linear algebraic and mathematical perspective. Before beginning the class make sure that you have the following: a basic understanding of linear algebra and multivariate calculus; a basic understanding of statistics and regression models; at least a little familiarity with proof based mathematics; basic knowledge of the R programming language.

Nov 16th 2026
5-12 Weeks
Robotic Mapping and Trajectory Generation (Coursera) Coursera
University of Colorado Boulder

Robotic Mapping and Trajectory Generation (Coursera)

In this second course of the Introduction to Robotics specialization, "Robotic Mapping and Trajectory Generation", you will learn how to perform basic inverse kinematics of (non-)holonomic systems using a feedback control approach. You will also learn how to process multi-dimensional sensor signals such as laser range scanners for mapping. Additionally, you will apply the overarching focus of mechanisms and sensors as sources of uncertainty and gain techniques to how to model and control them.

Nov 16th 2026
5-12 Weeks
Introduction to Linear Algebra (Coursera) Coursera
The University of Sydney

Introduction to Linear Algebra (Coursera)

Linear algebra and calculus are the two most important foundational pillars on which modern mathematics is built. They are studied by almost all mathematics students at university, though typically labelled as different subjects and taught in parallel. Over time, students discover that linear algebra and calculus are inseparable (but not identical) twins that interlock to form the backbone of almost all applications of mathematics to physical and biological sciences, engineering and computer science. It is recommended that participants in the MOOC Introduction to Linear Algebra have already taken, or take in parallel, the MOOC Introduction to Calculus.

Nov 23rd 2026
4 Weeks
Deep Learning and Reinforcement Learning (Coursera) Coursera
IBM

Deep Learning and Reinforcement Learning (Coursera)

This course introduces you to two of the most sought-after disciplines in Machine Learning: Deep Learning and Reinforcement Learning. Deep Learning is a subset of Machine Learning that has applications in both Supervised and Unsupervised Learning, and is frequently used to power most of the AI applications that we use on a daily basis. First you will learn about the theory behind Neural Networks, which are the basis of Deep Learning, as well as several modern architectures of Deep Learning.

Nov 23rd 2026
5-12 Weeks
First Steps in Linear Algebra for Machine Learning (Coursera) Coursera
Higher School of Economics - HSE University

First Steps in Linear Algebra for Machine Learning (Coursera)

The main goal of the course is to explain the main concepts of linear algebra that are used in data analysis and machine learning. Another goal is to improve the student’s practical skills of using linear algebra methods in machine learning and data analysis. You will learn the fundamentals of working with data in vector and matrix form, acquire skills for solving systems of linear algebraic equations and finding the basic matrix decompositions and general understanding of their applicability.

May 9th 2022
4 Weeks