Calculus and Optimization for Machine Learning (Coursera)

Calculus and Optimization for Machine Learning (Coursera)

Hi! Our course aims to provide necessary background in Calculus sufficient for up-following Data Science courses. Course starts with a basic introduction to concepts concerning functional mappings. Later students are assumed to study limits (in case of sequences, single- and multivariate functions), differentiability (once again starting from single variable up to multiple cases), integration, thus sequentially building up a base for the basic optimisation.

Class Deals by MOOC List - Click here and see Coursera's Active Discounts, Deals, and Promo Codes.

To provide an understanding of the practical skills set being taught, the course introduces the final programming project considering the usage of optimisation routine in machine learning.
Additional materials provided during the course include interactive plots in GeoGebra environment used during lectures, bonus reading materials with more general methods and more complicated basis for discussed themes.
Course 2 of 4 in the Mathematics for Data Science Specialization.

Syllabus

WEEK 1
Introduction: Numerical Sets, Functions, Limits
Here we introduce basic concept the calculus course could not be imagine without: function. In order to properly do it, one should say that the function is a mapping from one set to another. Thus, we start with the ideas of numerical sets and mapping, then proceeding with functions itself. Since we are particularly interested in functions' graph, we spend a lot of time discussing simplest ways to produce a complex function graph from elementary case. In the second part of the week we start our calculus journey with a discrete limit, the limit of sequences, and master skills needed to calculate them.

WEEK 2
Limits and Multivariate Functions
Now it is time to move from discrete limits to continuous ones: in other words, in the current module we are going to discuss limits of functions. We start with the basic question: does this case sufficiently differ from the sequences? Turns out, yes, it does thanks to significant structural differences between natural and real numbers. One of those differences - the continuousness - allows us to define and calculate limits at finite moments. We spend some time specifically on the famous important limits, then we proceed with the idea of asymptotic comparison of functions, Big- and little-o notations. To top our module with, we introduce functions of several variables and spend some time getting used to conveniently plot and interpret them, finishing up with discussion of its limits.

WEEK 3
Derivatives and Linear Approximations: Singlevariate Functions
Since we now know limits, let us use them in order to define some instantaneous characteristics of functions starting with its slope. Thus we define function's derivative and discuss all the machinery to calculate it. Since it is a purely technical issue, you are expected to be able to do it: in order to make sure that you can find a derivative we provide a drill. This skills could be used for finding approximate values via linear approximation or during the search for extremal values. To provide an understanding of the sufficient condition of the extremum, we introduce the concept of convexity.

WEEK 4
Derivatives and Linear Approximations: Multivariate Functions
Whilst we have discussed all linear related concepts for single variate functions, it is essential to try and generalise it for the multivariate case. Since the derivative concept is hard to stretch directly, we start with the idea of linear approximation and tangent plane; thus we introduce partial derivatives and the differentiability. We separately spend sometime discussing neural network inspired composite multivariate functions and all-mighty chain rule. Our generalisation attempt finalised with the idea of convexity in terms of the second partial derivatives.

WEEK 5
Integrals: Anti-derivative, Area under Curve
As we introduced the operation of differentiation, it is essential to think about the inverse procedure - the integration. We start the module with basic definition of the integration and, as usual, all techniques required to calculate wide range of the indefinite integrals, stressing out that the result is not guaranteed now. Then we proceed with the idea and formal definition of area under curve and its relation to the indefinite case - the fundamental theorem of calculus. We finish our week with the discussion of the areas of infinite figures (improper integrals) and numerical methods to assess the value of the definite integral.

WEEK 6
Optimization: Directional derivative, Extrema and Gradient Descent
As we built up impressive base by introducing various estimations of change and overall function's behaviour, it is essential to speak about general idea of the optimisation procedure. Since we already tackled it in a single variate case, we try to generalise our principles of necessary and sufficient conditions to the case of multivariate functions. Whilst it provides theoretical understanding, one should seek for faster iterative way to find an extremal point. In order to do it, we start our week with the concept of the directional derivative in order to provide and understanding of the desired direction of iterative search. Thus we produce the idea and motivation of the gradient descent, the last and final concept in our course you are asked to master.

Go to Class
MOOC List is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Related Courses

Data Science Math Skills (Coursera) Coursera
Duke University

Data Science Math Skills (Coursera)

Data science courses contain math—no avoiding that! This course is designed to teach learners the basic math you will need in order to be successful in almost any data science math course and was created for learners who have basic math skills but may not have taken algebra or pre-calculus. Data Science Math Skills introduces the core math that data science is built upon, with no extra complexity, introducing unfamiliar ideas and math symbols one-at-a-time.

Nov 2nd 2026
4 Weeks
Code Free Data Science (Coursera) Coursera
University of California, San Diego

Code Free Data Science (Coursera)

The Code Free Data Science class is designed for learners seeking to gain or expand their knowledge in the area of Data Science. Participants will receive the basic training in effective predictive analytic approaches accompanying the growing discipline of Data Science without any programming requirements. Machine Learning methods will be presented by utilizing the KNIME Analytics Platform to discover patterns and relationships in data.

Oct 26th 2026
4 Weeks
Calculus: Single Variable Part 4 - Applications (Coursera) Coursera
University of Pennsylvania

Calculus: Single Variable Part 4 - Applications (Coursera)

Calculus is one of the grandest achievements of human thought, explaining everything from planetary orbits to the optimal size of a city to the periodicity of a heartbeat. This brisk course covers the core ideas of single-variable Calculus with emphases on conceptual understanding and applications. The course is ideal for students beginning in the engineering, physical, and social sciences.

Oct 26th 2026
5-12 Weeks
AI Materials (Coursera) Coursera
Korea Advanced Institute of Science and Technology - KAIST

AI Materials (Coursera)

Learn about the materials that have advanced the performance of artificial intelligence, and the machine learning models that could help accelerate the design and development of novel materials. This course defines artificial intelligence (AI) as a machine to which some or all of the functions of the human brain have been delegated. It highlights the need, and explains in an easy-to-understand way how machine learning from artificial intelligence can dramatically accelerate the development of new materials.

Nov 2nd 2026
5-12 Weeks
Geometría Analítica Preuniversitaria (Coursera) Coursera
Universidad Autónoma Metropolitana

Geometría Analítica Preuniversitaria (Coursera)

Líneas rectas, círculos, parábolas, elipses e hipérbolas son figuras geométricas que encontramos en nuestro derredor. Por ejemplo, mucha gente sabe que los planetas en nuestro sistema solar se mueven en órbitas elípticas teniendo al astro rey en un foco de esta figura. Sin embargo, pocos saben que la plaza de San Pedro en el Vaticano está construída sobre elipses donde sus focos se encuentran sobre las fuentes donde mucha gente se toma fotos. Estos son dos ejemplos que muestran la importancia de las figuras geométricas en nuestra vida.

Nov 2nd 2026
5-12 Weeks
Probabilistic Graphical Models 1: Representation (Coursera) Coursera
Stanford University

Probabilistic Graphical Models 1: Representation (Coursera)

Probabilistic graphical models (PGMs) are a rich framework for encoding probability distributions over complex domains: joint (multivariate) distributions over large numbers of random variables that interact with each other. These representations sit at the intersection of statistics and computer science, relying on concepts from probability theory, graph algorithms, machine learning, and more. They are the basis for the state-of-the-art methods in a wide variety of applications, such as medical diagnosis, image understanding, speech recognition, natural language processing, and many, many more. They are also a foundational tool in formulating many machine learning problems.

Oct 26th 2026
5-12 Weeks
Machine Teaching for Autonomous AI (Coursera) Coursera
University of Washington

Machine Teaching for Autonomous AI (Coursera)

Just as teachers help students gain new skills, the same is true of artificial intelligence (AI). Machine learning algorithms can adapt and change, much like the learning process itself. Using the machine teaching paradigm, a subject matter expert (SME) can teach AI to improve and optimize a variety of systems and processes. The result is an autonomous AI system.

Nov 2nd 2026
4 Weeks
The Finite Element Method for Problems in Physics (Coursera) Coursera
University of Michigan

The Finite Element Method for Problems in Physics (Coursera)

This course is an introduction to the finite element method as applicable to a range of problems in physics and engineering sciences. The treatment is mathematical, but only for the purpose of clarifying the formulation. The emphasis is on coding up the formulations in a modern, open-source environment that can be expanded to other applications, subsequently.

Nov 2nd 2026
13-24 Weeks
Probabilistic Graphical Models 3: Learning (Coursera) Coursera
Stanford University

Probabilistic Graphical Models 3: Learning (Coursera)

Probabilistic graphical models (PGMs) are a rich framework for encoding probability distributions over complex domains: joint (multivariate) distributions over large numbers of random variables that interact with each other. These representations sit at the intersection of statistics and computer science, relying on concepts from probability theory, graph algorithms, machine learning, and more. They are the basis for the state-of-the-art methods in a wide variety of applications, such as medical diagnosis, image understanding, speech recognition, natural language processing, and many, many more. They are also a foundational tool in formulating many machine learning problems.

Oct 26th 2026
5-12 Weeks
Initiation à la théorie des distributions (Coursera) Coursera
École Polytechnique

Initiation à la théorie des distributions (Coursera)

Une fonction discontinue peut-elle être solution d'une équation différentielle? Comment définir rigoureusement la masse de Dirac (une "fonction" d'intégrale un, nulle partout sauf en un point) et ses dérivées? Peut-on définir une notion de "dérivée d'ordre fractionnaire"? Cette initiation aux distributions répond à ces questions - et à bien d'autres.

Nov 2nd 2026
5-12 Weeks