Transformer Models and BERT Model (Coursera)

Offered by Google Cloud,
Transformer Models and BERT Model (Coursera)

This course introduces you to the Transformer architecture and the Bidirectional Encoder Representations from Transformers (BERT) model. You learn about the main components of the Transformer architecture, such as the self-attention mechanism, and how it is used to build the BERT model. You also learn about the different tasks that BERT can be used for, such as text classification, question answering, and natural language inference.

Class Deals by MOOC List - Click here and see Coursera's Active Discounts, Deals, and Promo Codes.

This course is estimated to take approximately 45 minutes to complete.

What you'll learn

  • Understand the main components of the Transformer architecture.
  • Learn how a BERT model is built using Transformers.
  • Use BERT to solve different natural language processing (NLP) tasks.

Syllabus

Transformer Models and BERT Model: Overview
Module 1
In this module you will learn about the main components of the Transformer architecture, such as the self-attention mechanism, and how it is used to build the BERT model. You also learn about the different tasks that BERT can be used for, such as text classification, question answering, and natural language inference.

Go to Class
MOOC List is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Related Courses

Exam Prep AI-102: Microsoft Azure AI Engineer Associate (Coursera) Coursera
Whizlabs

Exam Prep AI-102: Microsoft Azure AI Engineer Associate (Coursera)

The AI-102: Designing and Implementing a Microsoft Azure AI Solution certification exam tests the candidate’s experience and knowledge of the AI solutions that make the most of Azure Cognitive Services and Azure services. In addition, the exam also tests the candidate's ability to implement this knowledge by participating in all phases of AI solutions development—from defining requirements, and design to development, deployment, integration, maintenance, performance tuning, and monitoring.

Aug 24th 2026
5-12 Weeks
Artificial Intelligence in Bioinformatics (FutureLearn) FutureLearn
Taipei Medical University

Artificial Intelligence in Bioinformatics (FutureLearn)

Discover the future of bioinformatics and learn how AI models of bioinformatics data help us to understand biological processes. Study the use of AI, machine learning, and deep learning in bioinformatics. This course will teach you the fundamentals of how AI is applied in the field of bioinformatics.

Self Paced
3 Weeks
AI and Disaster Management (Coursera) Coursera
DeepLearning.AI

AI and Disaster Management (Coursera)

In Course 3, AI and Disaster Management, you will begin by learning how natural disasters create both short and long-term impacts on the economy, environment, and community. You will learn how the disaster management cycle can be used to reduce the impacts of a disaster and guidelines for how you can engage in disaster-related projects.

Aug 24th 2026
3 Weeks
Clinical Natural Language Processing (Coursera) Coursera
University of Colorado System

Clinical Natural Language Processing (Coursera)

This course teaches you the fundamentals of clinical natural language processing (NLP). In this course you will learn the basic linguistic principals underlying NLP, as well as how to write regular expressions and handle text data in R. You will also learn practical techniques for text processing to be able to extract information from clinical notes.

Aug 24th 2026
5-12 Weeks
Information Extraction from Free Text Data in Health (Coursera) Coursera
University of Michigan

Information Extraction from Free Text Data in Health (Coursera)

In this MOOC, you will be introduced to advanced machine learning and natural language processing techniques to parse and extract information from unstructured text documents in healthcare, such as clinical notes, radiology reports, and discharge summaries. Whether you are an aspiring data scientist or an early or mid-career professional in data science or information technology in healthcare, it is critical that you keep up-to-date your skills in information extraction and analysis.

Aug 31st 2026
4 Weeks
Understanding and Applying Text Embeddings (Coursera) Coursera
DeepLearning.AI

Understanding and Applying Text Embeddings (Coursera)

The Vertex AI Text-Embeddings API enhances the process of generating text embeddings. These text embeddings, which are numerical representations of text, play a pivotal role in many tasks involving the identification of similar items, like Google searches, online shopping recommendations, and personalized music suggestions.

Aug 17th 2026
1 Week
Natural Language Processing and Capstone Assignment (Coursera) Coursera
University of California, Irvine

Natural Language Processing and Capstone Assignment (Coursera)

Welcome to Natural Language Processing and Capstone Assignment. In this course we will begin with an Recognize how technical and business techniques can be used to deliver business insight, competitive intelligence, and consumer sentiment. The course concludes with a capstone assignment in which you will apply a wide range of what has been covered in this specialization.

Aug 24th 2026
4 Weeks
Sequence Models (Coursera) Coursera
DeepLearning.AI

Sequence Models (Coursera)

This course will teach you how to build models for natural language, audio, and other sequence data. Thanks to deep learning, sequence algorithms are working far better than just two years ago, and this is enabling numerous exciting applications in speech recognition, music synthesis, chatbots, machine translation, natural language understanding, and many others.

Aug 17th 2026
3 Weeks
Hands-on Machine Learning with AWS and NVIDIA (Coursera) Coursera
AWS,NVIDIA

Hands-on Machine Learning with AWS and NVIDIA (Coursera)

Machine learning (ML) projects can be complex, tedious, and time consuming. AWS and NVIDIA solve this challenge with fast, effective, and easy-to-use capabilities for your ML project. This course is designed for ML practitioners, including data scientists and developers, who have a working knowledge of machine learning workflows. In this course, you will gain hands-on experience on building, training, and deploying scalable machine learning models with Amazon SageMaker and Amazon EC2 instances powered by NVIDIA GPUs.

Jul 22nd 2024
4 Weeks