Coursera

Transformer Models and BERT Model (Coursera)

Offered by Google Cloud,
Transformer Models and BERT Model (Coursera)

This course introduces you to the Transformer architecture and the Bidirectional Encoder Representations from Transformers (BERT) model. You learn about the main components of the Transformer architecture, such as the self-attention mechanism, and how it is used to build the BERT model. You also learn about the different tasks that BERT can be used for, such as text classification, question answering, and natural language inference.

Class Deals by MOOC List - Click here and see Coursera's Active Discounts, Deals, and Promo Codes.

This course is estimated to take approximately 45 minutes to complete.

What you'll learn

  • Understand the main components of the Transformer architecture.
  • Learn how a BERT model is built using Transformers.
  • Use BERT to solve different natural language processing (NLP) tasks.

Syllabus

Transformer Models and BERT Model: Overview
Module 1
In this module you will learn about the main components of the Transformer architecture, such as the self-attention mechanism, and how it is used to build the BERT model. You also learn about the different tasks that BERT can be used for, such as text classification, question answering, and natural language inference.

Go to Class
MOOC List is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Related Courses

Artificial Intelligence in Bioinformatics (FutureLearn) FutureLearn
Taipei Medical University

Artificial Intelligence in Bioinformatics (FutureLearn)

Robotics & Computer Vision

Discover the future of bioinformatics and learn how AI models of bioinformatics data help us to understand biological processes. Study the use of AI, machine learning, and deep learning in bioinformatics. This course will teach you the fundamentals of how AI is applied in the field of bioinformatics.

Self Paced
3 Weeks
Artificial Intelligence Machine Learning Bioinformatics
Details
Computational Social Science Capstone Project (Coursera) Coursera
University of California, Davis

Computational Social Science Capstone Project (Coursera)

Statistics & Data Analysis Data Science

CONGRATULATIONS! Not only did you accomplish to finish our intellectual tour de force, but, by now, you also already have all required skills to execute a comprehensive multi-method workflow of computational social science. We will put these skills to work in this final integrative lab, where we are bringing it all together. We scrape data from a social media site (drawing on the skills obtained in the 1st course of this specialization). We then analyze the collected data by visualizing the resulting networks (building on the skills obtained in the 3rd course). We analyze some key aspects of it in depth, using machine learning powered natural language processing (putting to work the insights obtained during the 2nd course).

Oct 12th 2026
4 Weeks
Machine Learning Social Networks Network Analysis
Details
Hands-on Machine Learning with AWS and NVIDIA (Coursera) Coursera
AWS,NVIDIA

Hands-on Machine Learning with AWS and NVIDIA (Coursera)

Data Science

Machine learning (ML) projects can be complex, tedious, and time consuming. AWS and NVIDIA solve this challenge with fast, effective, and easy-to-use capabilities for your ML project. This course is designed for ML practitioners, including data scientists and developers, who have a working knowledge of machine learning workflows. In this course, you will gain hands-on experience on building, training, and deploying scalable machine learning models with Amazon SageMaker and Amazon EC2 instances powered by NVIDIA GPUs.

Jul 22nd 2024
4 Weeks
ML NLP Machine Learning
Details
Applying Data Analytics in Accounting (Coursera) Coursera
University of Illinois at Urbana-Champaign

Applying Data Analytics in Accounting (Coursera)

Business

This course explores business analytic applications in accounting. First, it presents a survey of technology topics in accounting, including process mining, blockchain and applications in audit, tax, and assurance. Next, the course explores visualization and basic analytics in audit and control testing using R and Alteryx. Next, the course examines the uses of text analysis in accounting and conducts text analysis using R and RStudio. Finally, the course examines robot process automation in general using UiPath and its applications in accounting.

Oct 12th 2026
4 Weeks
NLP Accounting Cybersecurity
Details
Cohere - An Introduction (Coursera) Coursera
Board Infinity

Cohere - An Introduction (Coursera)

Data Science

"Cohere - An Introduction" is a comprehensive course designed to provide a deep dive into the world of Cohere, a leading platform in natural language processing (NLP). Spanning three modules, the course begins with the fundamentals of Cohere, exploring its NLP capabilities, basic operations, and setup. The second module advances into developing with Cohere, covering advanced text generation, text analysis, and practical application development. The final module focuses on integrating Cohere with other technologies, optimizing performance, and exploring future possibilities in NLP and AI.

Jul 6th 2026
3 Weeks
NLP Optimization Natural Language Processing
Details
Natural Language Processing with Probabilistic Models (Coursera) Coursera
DeepLearning.AI

Natural Language Processing with Probabilistic Models (Coursera)

Data Science

In Course 2 of the Natural Language Processing Specialization, offered by deeplearning.ai, you will: a) Create a simple auto-correct algorithm using minimum edit distance and dynamic programming; b) Apply the Viterbi Algorithm for part-of-speech (POS) tagging, which is important for computational linguistics, c) Write a better auto-complete algorithm using an N-gram language model, and d) Write your own Word2Vec model that uses a neural network to compute word embeddings using a continuous bag-of-words model.

Oct 5th 2026
4 Weeks
NLP Machine Learning Neural Networks
Details
AI and Disaster Management (Coursera) Coursera
DeepLearning.AI

AI and Disaster Management (Coursera)

Data Science

In Course 3, AI and Disaster Management, you will begin by learning how natural disasters create both short and long-term impacts on the economy, environment, and community. You will learn how the disaster management cycle can be used to reduce the impacts of a disaster and guidelines for how you can engage in disaster-related projects.

Oct 5th 2026
3 Weeks
Artificial Intelligence Natural Disasters Computer Vision
Details
Getting Started with AWS Machine Learning (Coursera) Coursera
AWS

Getting Started with AWS Machine Learning (Coursera)

Data Science

Machine learning (ML) is one of the fastest growing areas in technology and a highly sought after skillset in today’s job market. The World Economic Forum states the growth of artificial intelligence (AI) could create 58 million net new jobs in the next few years, yet it’s estimated that currently there are 300,000 AI engineers worldwide, but millions are needed.

Aug 21st 2023
5-12 Weeks
Artificial Intelligence NLP Machine Learning
Details