Transformer Models and BERT Model (Coursera)

Offered by Google Cloud,
Transformer Models and BERT Model (Coursera)

This course introduces you to the Transformer architecture and the Bidirectional Encoder Representations from Transformers (BERT) model. You learn about the main components of the Transformer architecture, such as the self-attention mechanism, and how it is used to build the BERT model. You also learn about the different tasks that BERT can be used for, such as text classification, question answering, and natural language inference.

Class Deals by MOOC List - Click here and see Coursera's Active Discounts, Deals, and Promo Codes.

This course is estimated to take approximately 45 minutes to complete.

What you'll learn

  • Understand the main components of the Transformer architecture.
  • Learn how a BERT model is built using Transformers.
  • Use BERT to solve different natural language processing (NLP) tasks.

Syllabus

Transformer Models and BERT Model: Overview
Module 1
In this module you will learn about the main components of the Transformer architecture, such as the self-attention mechanism, and how it is used to build the BERT model. You also learn about the different tasks that BERT can be used for, such as text classification, question answering, and natural language inference.

Go to Class
MOOC List is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Related Courses

Cohere - An Introduction (Coursera) Coursera
Board Infinity

Cohere - An Introduction (Coursera)

"Cohere - An Introduction" is a comprehensive course designed to provide a deep dive into the world of Cohere, a leading platform in natural language processing (NLP). Spanning three modules, the course begins with the fundamentals of Cohere, exploring its NLP capabilities, basic operations, and setup. The second module advances into developing with Cohere, covering advanced text generation, text analysis, and practical application development. The final module focuses on integrating Cohere with other technologies, optimizing performance, and exploring future possibilities in NLP and AI.

Jul 6th 2026
3 Weeks
Artificial Intelligence in Bioinformatics (FutureLearn) FutureLearn
Taipei Medical University

Artificial Intelligence in Bioinformatics (FutureLearn)

Discover the future of bioinformatics and learn how AI models of bioinformatics data help us to understand biological processes. Study the use of AI, machine learning, and deep learning in bioinformatics. This course will teach you the fundamentals of how AI is applied in the field of bioinformatics.

Self Paced
3 Weeks
Sequence Models (Coursera) Coursera
DeepLearning.AI

Sequence Models (Coursera)

This course will teach you how to build models for natural language, audio, and other sequence data. Thanks to deep learning, sequence algorithms are working far better than just two years ago, and this is enabling numerous exciting applications in speech recognition, music synthesis, chatbots, machine translation, natural language understanding, and many others.

Oct 12th 2026
3 Weeks
Introduction to Machine Learning (Coursera) Coursera
Duke University

Introduction to Machine Learning (Coursera)

This course will provide you a foundational understanding of machine learning models (logistic regression, multilayer perceptrons, convolutional neural networks, natural language processing, etc.) as well as demonstrate how these models can solve complex problems in a variety of industries, from medical diagnostics to image recognition to text prediction.

Oct 19th 2026
5-12 Weeks
Introduction to Generative AI (Coursera) Coursera
University of Colorado Boulder

Introduction to Generative AI (Coursera)

This introductory course offers a comprehensive exploration of Generative AI, including Transformers, ChatGPT for generating text, and Generative Adversarial Networks (GANs), the Diffusion Model for generating images. By the end of this course, you will gain a basic understanding of these Generative AI models, their underlying theories, and practical considerations. You will build a solid foundation and become ready to dive deeper into more advanced topics in the next course.

Jun 29th 2026
4 Weeks
Artificial Intelligence on Microsoft Azure (Coursera) Coursera
Microsoft

Artificial Intelligence on Microsoft Azure (Coursera)

Whether you're just beginning to work with Artificial Intelligence (AI) or you already have AI experience and are new to Microsoft Azure, this course provides you with everything you need to get started. Artificial Intelligence (AI) empowers amazing new solutions and experiences; and Microsoft Azure provides easy to use services to help you build solutions that seemed like science fiction a short time ago; enabling incredible advances in health care, financial management, environmental protection, and other areas to make a better world for everyone.

Oct 5th 2026
1 Week
Hands-on Machine Learning with AWS and NVIDIA (Coursera) Coursera
AWS,NVIDIA

Hands-on Machine Learning with AWS and NVIDIA (Coursera)

Machine learning (ML) projects can be complex, tedious, and time consuming. AWS and NVIDIA solve this challenge with fast, effective, and easy-to-use capabilities for your ML project. This course is designed for ML practitioners, including data scientists and developers, who have a working knowledge of machine learning workflows. In this course, you will gain hands-on experience on building, training, and deploying scalable machine learning models with Amazon SageMaker and Amazon EC2 instances powered by NVIDIA GPUs.

Jul 22nd 2024
4 Weeks
Machine Learning and NLP Basics (Coursera) Coursera
Edureka

Machine Learning and NLP Basics (Coursera)

Welcome to the "Machine Learning and NLP Basics" course, a comprehensive learning resource designed for enthusiasts keen on mastering the foundational aspects of machine learning (ML) and natural language processing (NLP). This course is structured to provide a deep dive into the core concepts, algorithms, and applications of ML and NLP, preparing you for advanced exploration and application in these fields.

Oct 12th 2026
4 Weeks
Natural Language Processing with Sequence Models (Coursera) Coursera
DeepLearning.AI

Natural Language Processing with Sequence Models (Coursera)

In Course 3 of the Natural Language Processing Specialization, offered by deeplearning.ai, you will: a) Train a neural network with GLoVe word embeddings to perform sentiment analysis of tweets, b) Generate synthetic Shakespeare text using a Gated Recurrent Unit (GRU) language model, c) Train a recurrent neural network to perform named entity recognition (NER) using LSTMs with linear layers, and d) Use so-called ‘Siamese’ LSTM models to compare questions in a corpus and identify those that are worded differently but have the same meaning.

Oct 5th 2026
4 Weeks