Self-Attention Mechanisms Courses and Certifications

Learning the Structure of EHR with Graph Convolutional Transformer - Edward Choi

Stanford University offers a 1-2 hour session on understanding EHR structure using graph convolutional transformer, led by Edward Choi. The session includes case studies, comparisons, and interactive Q&A.

• YouTube
• 1 hour 30 minutes
• On-Demand
• Free Online Course

Stanford Seminar 2022 - Self Attention and Non-Parametric Transformers

Explore Transformer origins and Non-Parametric Transformers (NPTs) in this Stanford University seminar. Learn from Oxford PhD students and delve into neural networks and Bayesian deep learning.

• YouTube
• 1 hour 6 minutes
• On-Demand
• Free Online Course

Transformer Models and BERT Model

39 ratings at Coursera

This course introduces you to the Transformer architecture and the Bidirectional Encoder Representations from Transformers (BERT) model. You learn about the main components of the Transformer architecture, such as the self-attention mechanism, and how it…

• Coursera
• 51 minutes
• On-Demand
• Free Online Course (Audit)

Institute for Pure & Applied Mathematics (IPAM)

Collective Intelligence for Deep Learning - A Survey of Recent Developments

Explore the intersection of collective intelligence and deep learning with David Ha of Google Brain, in a brief, insightful session offered by IPAM.

• YouTube
• 28 minutes
• On-Demand
• Free Online Course

Transformer Models and BERT Model - Locales

This course, Transformer Models and BERT Model - Locales, is intended for non-English learners. If you want to take this course in English, please enroll in Transformer Models and BERT Model. This course introduces you to the Transformer architecture and…

• Google Cloud Skills Boost
• 8 hours
• On-Demand
• Free Online Course

Transformer Models and BERT Model

Learn about Transformer and BERT models, their components like self-attention mechanism, and their applications in text classification and more in this 45-minute course by Google.

• Google Cloud Skills Boost
• 30 minutes
• On-Demand
• Free Certificate

Transformer Models and BERT Model

This course introduces you to the Transformer architecture and the Bidirectional Encoder Representations from Transformers (BERT) model. You learn about the main components of the Transformer architecture, such as the self-attention mechanism, and how it…

• Pluralsight
• 24 minutes
• On-Demand
• Free Trial Available

Yannic Kilcher

Linformer - Self-Attention with Linear Complexity

Explore the Linformer model's efficient approach to Transformers' self-attention mechanism in this under 1-hour material by Yannic Kilcher.

• YouTube
• 50 minutes
• On-Demand
• Free Online Course

Yannic Kilcher

Synthesizer - Rethinking Self-Attention in Transformer Models

Explore the Synthesizer model and its impact on Transformers in this concise study by Yannic Kilcher. Learn about attention mechanisms, synthetic attention, and their applications in language modeling and translation.

• YouTube
• 48 minutes
• On-Demand
• Free Online Course

Yannic Kilcher

Axial-DeepLab - Stand-Alone Axial-Attention for Panoptic Segmentation

Explore the shift from Convolutional Neural Networks to transformers in image processing with Yannic Kilcher's under 1-hour material. Learn about Axial Attention and its applications.

• YouTube
• 56 minutes
• On-Demand
• Free Online Course

Jay Alammar

The Narrated Transformer Language Model

Explore the Transformer architecture in AI/ML with Jay Alammar's visual presentation, suitable for various levels of ML experience. Learn model training, tokenization, and more in under an hour.

• YouTube
• 30 minutes
• On-Demand
• Free Online Course

Simons Institute

Knowledge Is Embedded in Language Neural Networks but Can They Reason?

Explore the challenges of deep learning with Stanford's Chris Manning in this under 1-hour material from Simons Institute. Dive into language modeling, transformer models, and neural state machines.

• YouTube
• 50 minutes
• On-Demand
• Free Online Course

Alfredo Canziani

Self - Cross, Hard - Soft Attention and the Transformer

Learn about self/cross, hard/soft attention, and the Transformer from Alfredo Canziani. Explore key-value store, queries, and PyTorch implementation in 1-2 hours.

• YouTube
• 1 hour 12 minutes
• On-Demand
• Free Online Course

Transformer Models and BERT Model - 简体中文

本课程向您介绍 Transformer 架构和 Bidirectional Encoder Representations from Transformers (BERT) 模型。您将了解 Transformer 架构的主要组成部分，例如自注意力机制，以及该架构如何用于构建 BERT 模型。您还将了解可以使用 BERT 的不同任务，例如文本分类、问答和自然语言推理。完成本课程估计需要大约 45 分钟。

• Coursera
• 51 minutes
• On-Demand
• Free Online Course (Audit)

Transformer Models and BERT Model - Français

Ce cours présente l'architecture Transformer et le modèle BERT (Bidirectional Encoder Representations from Transformers). Vous découvrirez quels sont les principaux composants de l'architecture Transformer, tels que le mécanisme d'auto-attention, et comm…

• Coursera
• 51 minutes
• On-Demand
• Free Online Course (Audit)