Calculus and Optimization for Machine Learning (Coursera)

Calculus and Optimization for Machine Learning (Coursera)

Hi! Our course aims to provide necessary background in Calculus sufficient for up-following Data Science courses. Course starts with a basic introduction to concepts concerning functional mappings. Later students are assumed to study limits (in case of sequences, single- and multivariate functions), differentiability (once again starting from single variable up to multiple cases), integration, thus sequentially building up a base for the basic optimisation.

Class Deals by MOOC List - Click here and see Coursera's Active Discounts, Deals, and Promo Codes.

To provide an understanding of the practical skills set being taught, the course introduces the final programming project considering the usage of optimisation routine in machine learning.
Additional materials provided during the course include interactive plots in GeoGebra environment used during lectures, bonus reading materials with more general methods and more complicated basis for discussed themes.
Course 2 of 4 in the Mathematics for Data Science Specialization.

Syllabus

WEEK 1
Introduction: Numerical Sets, Functions, Limits
Here we introduce basic concept the calculus course could not be imagine without: function. In order to properly do it, one should say that the function is a mapping from one set to another. Thus, we start with the ideas of numerical sets and mapping, then proceeding with functions itself. Since we are particularly interested in functions' graph, we spend a lot of time discussing simplest ways to produce a complex function graph from elementary case. In the second part of the week we start our calculus journey with a discrete limit, the limit of sequences, and master skills needed to calculate them.

WEEK 2
Limits and Multivariate Functions
Now it is time to move from discrete limits to continuous ones: in other words, in the current module we are going to discuss limits of functions. We start with the basic question: does this case sufficiently differ from the sequences? Turns out, yes, it does thanks to significant structural differences between natural and real numbers. One of those differences - the continuousness - allows us to define and calculate limits at finite moments. We spend some time specifically on the famous important limits, then we proceed with the idea of asymptotic comparison of functions, Big- and little-o notations. To top our module with, we introduce functions of several variables and spend some time getting used to conveniently plot and interpret them, finishing up with discussion of its limits.

WEEK 3
Derivatives and Linear Approximations: Singlevariate Functions
Since we now know limits, let us use them in order to define some instantaneous characteristics of functions starting with its slope. Thus we define function's derivative and discuss all the machinery to calculate it. Since it is a purely technical issue, you are expected to be able to do it: in order to make sure that you can find a derivative we provide a drill. This skills could be used for finding approximate values via linear approximation or during the search for extremal values. To provide an understanding of the sufficient condition of the extremum, we introduce the concept of convexity.

WEEK 4
Derivatives and Linear Approximations: Multivariate Functions
Whilst we have discussed all linear related concepts for single variate functions, it is essential to try and generalise it for the multivariate case. Since the derivative concept is hard to stretch directly, we start with the idea of linear approximation and tangent plane; thus we introduce partial derivatives and the differentiability. We separately spend sometime discussing neural network inspired composite multivariate functions and all-mighty chain rule. Our generalisation attempt finalised with the idea of convexity in terms of the second partial derivatives.

WEEK 5
Integrals: Anti-derivative, Area under Curve
As we introduced the operation of differentiation, it is essential to think about the inverse procedure - the integration. We start the module with basic definition of the integration and, as usual, all techniques required to calculate wide range of the indefinite integrals, stressing out that the result is not guaranteed now. Then we proceed with the idea and formal definition of area under curve and its relation to the indefinite case - the fundamental theorem of calculus. We finish our week with the discussion of the areas of infinite figures (improper integrals) and numerical methods to assess the value of the definite integral.

WEEK 6
Optimization: Directional derivative, Extrema and Gradient Descent
As we built up impressive base by introducing various estimations of change and overall function's behaviour, it is essential to speak about general idea of the optimisation procedure. Since we already tackled it in a single variate case, we try to generalise our principles of necessary and sufficient conditions to the case of multivariate functions. Whilst it provides theoretical understanding, one should seek for faster iterative way to find an extremal point. In order to do it, we start our week with the concept of the directional derivative in order to provide and understanding of the desired direction of iterative search. Thus we produce the idea and motivation of the gradient descent, the last and final concept in our course you are asked to master.

Go to Class
MOOC List is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Related Courses

Practical Machine Learning on H2O (Coursera) Coursera
H2O.ai

Practical Machine Learning on H2O (Coursera)

In this course, we will learn all the core techniques needed to make effective use of H2O. Even if you have no prior experience of machine learning, even if your math is weak, by the end of this course you will be able to make machine learning models using a variety of algorithms. We will be using linear models, random forest, GBMs and of course deep learning, as well as some unsupervised learning algorithms.

Sep 14th 2026
5-12 Weeks
Aléatoire : une introduction aux probabilités - Partie 1 (Coursera) Coursera
École Polytechnique

Aléatoire : une introduction aux probabilités - Partie 1 (Coursera)

Ce cours d'introduction aux probabilités a la même contenu que le cours de tronc commun de première année de l'École polytechnique donné par Sylvie Méléard. Le cours introduit graduellement la notion de variable aléatoire et culmine avec la loi des grands nombres et le théorème de la limite centrale. Les notions mathématiques nécessaires sont introduites au fil du cours et de nombreux exercices corrigés sont proposés.

Sep 7th 2026
5-12 Weeks
Cadeia de Suprimentos na Nuvem (Coursera) Coursera
FIA Business School

Cadeia de Suprimentos na Nuvem (Coursera)

Nossas boas-vindas ao Curso Cadeia de Suprimentos na Nuvem. Neste curso, você aprenderá como o supply chain pode ampliar o valor da empresa explorando as diversas ferramentas disponíveis em cloud para potencializar a visibilidade e a responsividade da cadeia, melhorando o nível de serviço prestado aos clientes.

Sep 14th 2026
5-12 Weeks
Excel Modeling for Professionals: Best Practices & Pitfalls (Coursera) Coursera
Delft University of Technology,Erasmus University Rotterdam

Excel Modeling for Professionals: Best Practices & Pitfalls (Coursera)

Through this course learners will gain the tools to decide whether or not Excel is the right software to use. They will learn how to set up good input data, format correctly, and the importance of good documentation. Learners will gain the ability to discern between different functions, to understand the pitfalls and strengths of commonly used functions, and to apply correct functions to their excel models. Those that follow the course will also gain understanding of logical spreadsheet structure, graphs and reporting, and protection and hidden information in Excel, and users will learn how to apply these things to their own models.

Sep 14th 2026
4 Weeks
Conceptos y Herramientas para la Física Universitaria (Coursera) Coursera
Tecnológico de Monterrey

Conceptos y Herramientas para la Física Universitaria (Coursera)

Este curso provee al estudiante con conceptos y herramientas matemáticas para modelar problemas en física, que al aplicar podrá enfrentar con éxito los cursos de física universitarios. Así pues, la filosofía de este curso consiste en cubrir temas conceptuales relativos a la Física y desarrollar tu capacidad de aprender y aplicarlos en tu vida profesional.

Sep 14th 2026
5-12 Weeks
Machine Learning Introduction for Everyone (Coursera) Coursera
IBM

Machine Learning Introduction for Everyone (Coursera)

This three-module course introduces machine learning and data science for everyone with a foundational understanding of machine learning models. You’ll learn about the history of machine learning, applications of machine learning, the machine learning model lifecycle, and tools for machine learning. You’ll also learn about supervised versus unsupervised learning, classification, regression, evaluating machine learning models, and more.

Sep 14th 2026
3 Weeks
Analytic Combinatorics (Coursera) Coursera
Princeton University

Analytic Combinatorics (Coursera)

Analytic Combinatorics teaches a calculus that enables precise quantitative predictions of large combinatorial structures. This course introduces the symbolic method to derive functional relations among ordinary, exponential, and multivariate generating functions, and methods in complex analysis for deriving accurate asymptotics from the GF equations. All the features of this course are available for free. It does not offer a certificate upon completion.

Sep 7th 2026
5-12 Weeks
Experimentation for Improvement (Coursera) Coursera
McMaster University

Experimentation for Improvement (Coursera)

We are always using experiments to improve our lives, our community, and our work. Are you doing it efficiently? Or are you (incorrectly) changing one thing at a time and hoping for the best? In this course, you will learn how to plan efficient experiments - testing with many variables. Our goal is to find the best results using only a few experiments. A key part of the course is how to optimize a system.

Sep 14th 2026
5-12 Weeks
Introduction to Embedded Machine Learning (Coursera) Coursera
Edge Impulse

Introduction to Embedded Machine Learning (Coursera)

Machine learning allows us to teach computers to make predictions and decisions based on data and learn from experiences. In recent years, incredible optimizations have been made to machine learning algorithms, software frameworks, and embedded hardware. Thanks to this, running deep neural networks and other complex machine learning algorithms is possible on low-power devices like microcontrollers. This course will give you a broad overview of how machine learning works, how to train neural networks, and how to deploy those networks to microcontrollers.

Sep 13th 2026
3 Weeks