Transformer Models and BERT Model (Coursera)

Offered by Google Cloud,
Transformer Models and BERT Model (Coursera)

This course introduces you to the Transformer architecture and the Bidirectional Encoder Representations from Transformers (BERT) model. You learn about the main components of the Transformer architecture, such as the self-attention mechanism, and how it is used to build the BERT model. You also learn about the different tasks that BERT can be used for, such as text classification, question answering, and natural language inference.

Class Deals by MOOC List - Click here and see Coursera's Active Discounts, Deals, and Promo Codes.

This course is estimated to take approximately 45 minutes to complete.

What you'll learn

  • Understand the main components of the Transformer architecture.
  • Learn how a BERT model is built using Transformers.
  • Use BERT to solve different natural language processing (NLP) tasks.

Syllabus

Transformer Models and BERT Model: Overview
Module 1
In this module you will learn about the main components of the Transformer architecture, such as the self-attention mechanism, and how it is used to build the BERT model. You also learn about the different tasks that BERT can be used for, such as text classification, question answering, and natural language inference.

Go to Class
MOOC List is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Related Courses

Exam Prep AI-102: Microsoft Azure AI Engineer Associate (Coursera) Coursera
Whizlabs

Exam Prep AI-102: Microsoft Azure AI Engineer Associate (Coursera)

The AI-102: Designing and Implementing a Microsoft Azure AI Solution certification exam tests the candidate’s experience and knowledge of the AI solutions that make the most of Azure Cognitive Services and Azure services. In addition, the exam also tests the candidate's ability to implement this knowledge by participating in all phases of AI solutions development—from defining requirements, and design to development, deployment, integration, maintenance, performance tuning, and monitoring.

Jun 1st 2026
5-12 Weeks
Artificial Intelligence in Bioinformatics (FutureLearn) FutureLearn
Taipei Medical University

Artificial Intelligence in Bioinformatics (FutureLearn)

Discover the future of bioinformatics and learn how AI models of bioinformatics data help us to understand biological processes. Study the use of AI, machine learning, and deep learning in bioinformatics. This course will teach you the fundamentals of how AI is applied in the field of bioinformatics.

May 24th 2021
3 Weeks
Computer Applications of Artificial Intelligence and e-Construction (edX) EdX
Purdue University,PurdueX

Computer Applications of Artificial Intelligence and e-Construction (edX)

Learn the fundamentals of artificial intelligence, machine learning, natural language processing and their applications in e-Construction. This course is the third in a sequence of interrelated courses of the current computer applications in the construction industry. The emphasis of this course is the advanced computational tools including artificial intelligence, machine learning, and natural language processing, and their applications in e-Construction.

Mar 28th 2022
5-12 Weeks
Machine Learning and NLP Basics (Coursera) Coursera
Edureka

Machine Learning and NLP Basics (Coursera)

Welcome to the "Machine Learning and NLP Basics" course, a comprehensive learning resource designed for enthusiasts keen on mastering the foundational aspects of machine learning (ML) and natural language processing (NLP). This course is structured to provide a deep dive into the core concepts, algorithms, and applications of ML and NLP, preparing you for advanced exploration and application in these fields.

Jun 22nd 2026
4 Weeks
Advanced Tools for Digital Marketing Analytics (Coursera) Coursera
Unilever

Advanced Tools for Digital Marketing Analytics (Coursera)

The Advanced Tools for Digital Marketing Analytics course explores cutting-edge tools and technologies that are transforming the landscape of digital marketing analytics such as marketing automation and scaling strategies, predictive analytics and algorithms, video and mobile marketing trends, as well as artificial intelligence (AI), natural language processing (NLP), and ethics. You’ll also walk through preparing a portfolio and supporting a career change to digital marketing analyst.

Jun 22nd 2026
4 Weeks
Foundations of mining non-structured medical data (Coursera) Coursera
EIT Digital

Foundations of mining non-structured medical data (Coursera)

The goal of this course is to understand the foundations of Big Data and the data that is being generated in the health domain and how the use of technology would help to integrate and exploit all those data to extract meaningful information that can be later used in different sectors of the health domain from physicians to management, from patients to care givers, etc.

Jun 15th 2026
5-12 Weeks
NLP Modelos y Algoritmos (Coursera) Coursera
Universidad Austral

NLP Modelos y Algoritmos (Coursera)

Este curso te brindará los conocimientos necesarios para la implementación de algoritmos de NLP. Mediante el uso de los últimos algoritmos más populares en NLP se procederá a dar solución a un conjunto de problemas propios del área. Para realizar este curso es necesario contar con conocimientos de programación de nivel básico a medio, deseablemente conocimiento básico del lenguaje Python y es recomendable conocer los Jupyter Notebooks en el entorno Anaconda.

Jun 8th 2026
4 Weeks
Build, Train, and Deploy ML Pipelines using BERT (Coursera) Coursera
DeepLearning.AI,AWS

Build, Train, and Deploy ML Pipelines using BERT (Coursera)

In the second course of the Practical Data Science Specialization, you will learn to automate a natural language processing task by building an end-to-end machine learning pipeline using Hugging Face’s highly-optimized implementation of the state-of-the-art BERT algorithm with Amazon SageMaker Pipelines. Your pipeline will first transform the dataset into BERT-readable features and store the features in the Amazon SageMaker Feature Store. It will then fine-tune a text classification model to the dataset using a Hugging Face pre-trained model, which has learned to understand the human language from millions of Wikipedia documents.

Mar 25th 2024
3 Weeks
AI Workflow: Machine Learning, Visual Recognition and NLP (Coursera) Coursera
IBM

AI Workflow: Machine Learning, Visual Recognition and NLP (Coursera)

This is the fourth course in the IBM AI Enterprise Workflow Certification specialization. You are STRONGLY encouraged to complete these courses in order as they are not individual independent courses, but part of a workflow where each course builds on the previous ones. Course 4 covers the next stage of the workflow, setting up models and their associated data pipelines for a hypothetical streaming media company.

Jun 22nd 2026
2 Weeks
Introduction to Generative AI (Coursera) Coursera
University of Colorado Boulder

Introduction to Generative AI (Coursera)

This introductory course offers a comprehensive exploration of Generative AI, including Transformers, ChatGPT for generating text, and Generative Adversarial Networks (GANs), the Diffusion Model for generating images. By the end of this course, you will gain a basic understanding of these Generative AI models, their underlying theories, and practical considerations. You will build a solid foundation and become ready to dive deeper into more advanced topics in the next course.

Jun 15th 2026
4 Weeks
Cohere - An Introduction (Coursera) Coursera
Board Infinity

Cohere - An Introduction (Coursera)

"Cohere - An Introduction" is a comprehensive course designed to provide a deep dive into the world of Cohere, a leading platform in natural language processing (NLP). Spanning three modules, the course begins with the fundamentals of Cohere, exploring its NLP capabilities, basic operations, and setup. The second module advances into developing with Cohere, covering advanced text generation, text analysis, and practical application development. The final module focuses on integrating Cohere with other technologies, optimizing performance, and exploring future possibilities in NLP and AI.

Jun 8th 2026
3 Weeks