Visual Guide to Transformer Neural Networks - (Episode 2) Multi-Head & Self-Attention
Hedu AI by Batool Haider Hedu AI by Batool Haider
10.3K subscribers
157,324 views
0

 Published On Dec 8, 2020

Visual Guide to Transformer Neural Networks (Series) - Step by Step Intuitive Explanation

Episode 0 - [OPTIONAL] The Neuroscience of "Attention"
   • The Neuroscience of “Attention”  

Episode 1 - Position Embeddings
   • Visual Guide to Transformer Neural Ne...  

Episode 2 - Multi-Head & Self-Attention
   • Visual Guide to Transformer Neural Ne...  

Episode 3 - Decoder’s Masked Attention
   • Visual Guide to Transformer Neural Ne...  

This video series explains the math, as well as the intuition behind the Transformer Neural Networks that were first introduced by the “Attention is All You Need” paper.

--------------------------------------------------------------
References and Other Great Resources
--------------------------------------------------------------

Attention is All You Need
https://arxiv.org/abs/1706.03762

Jay Alammar – The Illustrated Transformer
http://jalammar.github.io/illustrated...

The A.I Hacker – Illustrated Guide to Transformers Neural Networks: A step by step explanation
http://jalammar.github.io/illustrated...

Amirhoussein Kazemnejad Blog Post - Transformer Architecture: The Positional Encoding
https://kazemnejad.com/blog/transform...

Yannic Kilcher Youtube Video – Attention is All You Need
https://www.youtube.com/watch?v=iDulh...

show more

Share/Embed