Visual Guide to Transformer Neural Networks - (Episode 2) Multi-Head & Self-Attention
Vložit
- čas přidán 31. 05. 2024
- Visual Guide to Transformer Neural Networks (Series) - Step by Step Intuitive Explanation
Episode 0 - [OPTIONAL] The Neuroscience of "Attention"
• The Neuroscience of “A...
Episode 1 - Position Embeddings
• Visual Guide to Transf...
Episode 2 - Multi-Head & Self-Attention
• Visual Guide to Transf...
Episode 3 - Decoder’s Masked Attention
• Visual Guide to Transf...
This video series explains the math, as well as the intuition behind the Transformer Neural Networks that were first introduced by the “Attention is All You Need” paper.
--------------------------------------------------------------
References and Other Great Resources
--------------------------------------------------------------
Attention is All You Need
arxiv.org/abs/1706.03762
Jay Alammar - The Illustrated Transformer
jalammar.github.io/illustrated...
The A.I Hacker - Illustrated Guide to Transformers Neural Networks: A step by step explanation
jalammar.github.io/illustrated...
Amirhoussein Kazemnejad Blog Post - Transformer Architecture: The Positional Encoding
kazemnejad.com/blog/transform...
Yannic Kilcher CZcams Video - Attention is All You Need
www.youtube.com/watch?v=iDulh...
*CORRECTIONS*
A big shoutout to the following awesome viewers for these 2 corrections:
1. @Henry Wang and @Holger Urbanek - At (10:28), "dk" is actually the hidden dimension of the Key matrix and not the sequence length. In the original paper (Attention is all you need), it is taken to be 512.
2. @JU PING NG
- The result of concatenation at (14:58) is supposed to be 7 x 9 instead of 21 x 3 (that is to so that the concatenation of z matrices happens horizontally and not vertically). With this we can apply a nn.Linear(9, 5) to get the final 7 x 5 shape.
Here are the timestamps associated with the concepts covered in this video:
0:00 - Recaps of Part 0 and 1
0:56 - Difference between Simple and Self-Attention
3:11 - Multi-Head Attention Layer - Query, Key and Value matrices
11:44 - Intuition for Multi-Head Attention Layer with Examples
Where's the first video?
@@amortalbeing Episode 0 can be found here - czcams.com/video/48gBPL7aHJY/video.html
@@HeduAI thanks a lot really appreciate it:)
Awesome...So dk value is 3?
@@omkiranmalepati1645 d_k = embedding dimensions // number of heads
Need to say this out loud, I saw Yannic Kilcher's video, read tonnes of materials on internet, went through atleast 7 playlists, and this is the first time I really understood the inner mechanism of Q, K and V vectors in transformers. You did a great job here
This made my day :,)
True
Very intuitive explanation!
Totally agree with this comment
Yes, no other video actually explains what the actual input for these are
All 3 parts have been the best presentation I've ever seen of Transformers. Your step-by-step visualizations have filled in so many gaps left by other videos and blog posts. Thank you very much for creating this series.
This comment made my day :,) Thanks!
Me, too!
Definitely agree. These videos really crystallize a lot of knowledge, thanks for making this series!
ش
@@HeduAI absolutely awesome . You are the best.
This is the best explanation of transformers on CZcams.
Damn. This is exactly what a developer coming from other backgrounds need.
Simple analogies for a rapid understanding.
Thanks a ton.
Keep uploadinggggggggggg plss
Agreed, very well done. You do a very good job of explaining difficult concepts to a non-industry developer (fyi I'm an accountant) without assuming a lot of prior knowledge. I look forward to your next video on masked decoders!!!
@@Xeneon341 Oh nice! Glad you enjoyed these videos! :)
Absolutely underrated, hands down one of the best explanations I've found on the internet
this channel needs more love (the way she explains is out of the box). I can say this because I have 4 years of experience in data science, she did a lot of hard work to get so much clarity in concepts (love from India)
Thank you Rohtash! You made my day! :) धन्यवाद
Coming back after a year, just to revise the basic concepts. It is still the best video on YT. Thanks Hedu AI
As someone NOT in the field reading the Attention paper, after having watched DOZENS of videos on the topic this is the FIRST explanation that laid it out in an intuitive manner without leaving anything out. I don't know your background, but you are definitely a great teacher. Thank you.
So glad to hear this :)
Self-attention is a villain that has struck me for a long time. Your presentation has helped me to better understand this genius idea.
The important detail that set you apart from the other videos and websites is that not only did you provide the model's architecture with numerous formulas but you also demonstrated them in vectors and matrixes, successfully walked us through each complicated and trivial concept. You really did a good job!
I won't say this is the best explanation so far, but this is the only explanation. Others are just repeating the original paper.
Finally a video on transformers that actually makes sense. Not a single lecture video from any of the reputed universities managed to cover the topic with such brilliant clarity.
Best explanation ever on Transformers !!!
Better than the best Berkeley professor! Amazing!
Were you the one who wrote transformers in the fist place, because no one explained it like you did. This is undoubtfully the best info I have seen. I hope you please keep posting more videos. Thanks a lot.
This comment made my day! :) Thank you.
I'm currently reading a book about transformers and was scratching my head over the reason for the multi-headed attention architecture.
Thank you so much for the clearest explanation yet that finally gave me this satisfying 💡-moment
This really is an excellent explanation. I had some sense that self-attention layers acted like a table of relationships between tokens, but only now do I have more sense of how the Query, Key, and Value mechanism actually works.
I've been stuck for so long trying to get the Transformer Neural Networks and this is by far the best explanation ! The examples are so fun making it easier to comprehend. Thank you so much for you effort !
Cheers!
This is one of the best Transformer videos on CZcams. I hope CZcams always recommends this Value (V), aka video, as a first Key (K), aka Video Title, when someone uses the Query (Q) as "Transformer"!! 😄
😄
3 days, 16 different videos, and your video "just made sense". You just earned a subscriber and a life-long well-wisher.
Literally the best series on transformers. Even clearer than statquest and luis serrano who also make things very clear
This is quite literally the best attention mechanism video out there guys
I went through many videos from Coursera, youtube, and some online blogs but none explained so clear about the Query, key, and values. You made my day.
Glad to hear this Shubhesh :)
The MOST MOST MOST MOST ..........................useful and THE BEST video ever on Multi head attention........Thanks a lot for your work
So glad you liked it! :)
best, best best explanation on transformer, you are adding so much value to the world.
The best explanation of attention models on the earth!
Wow. Just wow !! This video needs to be in the top most position when searched for content on transformers and their explanation
So glad to see this feedback! :)
Thank you for taking the time explain from a linear algebra perspective what actually happens. Many teachers on youtube are comfortable just leaving it at math symbols and labels. Showing what actually happens to matrice values has sharpened my intuition of what actually happens under the hood. Thank you.🙏
To visualize the matrices helped me to understand better transformers.
Again, thank you very much!
I just repeat what everybody else said: these videos are the best! thank you for the effort
Ah this makes everything simple and make sense
Thanks for the easy to follow explanation !
The best video I've ever seen for explaining transformer.
Being a professional in this field for ~5years can say this is by far the best explanation of attention.
Amused as to why this doesn't pop up on YT's recommendation for attention at the top. Probably, YT's attention needs some attention to fix its Q, K, Vs
You made my day :)
Finally! You delivered me from long nights of searching for good explanations about transformers! It was awesome! I can't wait to see the part 3 and beyond!
Thanks for this great feedback!
“Part 3 - Decoder’s Masked Attention” is out. Thanks for the wait. Enjoy! Cheers! :D
czcams.com/video/gJ9kaJsE78k/video.html
The best explanation I've ever seen of such a powerful architecture. I'm glad of having found this Joy after searching for positional encoding details while implementing a Transformer from scratch today. Valar Morghulis!
Valar Dohaeris my friend ;)
I can't believe how good this is.
Never posting but right now I need to thank you, I really don't believe that it exists a better way to understand self attention than watching your video. Thank you !
I'm a grad student currently applying NLP - this is literally the best explanation of self-attention I have ever seen. Thank you so much for a great vid!
Finally I understood the concept of query, key and value. Thank you.
I've watched many video series about transformers, this is by far the best.
I am just speechless, this is unbelievable! Bravo!
Its one of the best explainations of Transformers. Just mind blowing.
Amazing work. Really appreciate you, making complex topics into simple language with the touch of anime and series. Amazing.
Thank you so much! This is by far the clearest explanation that I've ever seen on this topic
This explanation is incredible and better than 99% of what I found on the Internet. Thank you!
thanks for these great videos! The visualizations and extra explanations on details are perfect!
You are the best😄😄, This is THE Best explanation I have ever seen on CZcams for Transformer Model, Thank you so much for this video.
Most underrated video about transformers. Going to recommend this to everyone. Thankyou
best transformer explanation on CZcams!
So glad to hear this! :D
Spectacular explanation! This channel is sooo underrated!
Holy shit was this a good explanation! Other blogs literally copy what the paper states (which is kinda confusing), but you explained it in such a intuitive and fun way! Thats what I called talent!!
Really love coming back to your videos and get a recap on multi layered attention and the transformers! Sometimes I need to make my own specialized attention layers for the dataset in question and sometimes i dunno it just helps to just listen to you talk about transformers and attention ! Really intuitive and helps me to break out of some weird loop of algorithm design I might have gotten myself stuck at. So thank you so so much :D
Hands down the best video on transformers I have seen! Thank you for taking your time to make this video.
This is literally the best explanation for self-attention I have seen anywhere! Really loved the videos!
really good intuition of self-attention and multi-attention
I am glad to hear that :)
@@HeduAI hi, thanks for your reply. When I read some papers, they mentioned ”attention map“, is that the same thing as ”attention filter“ mentioned in your video?
Hand down the best transformer explanation. Thank you very much!
This is the best explanation of transformers architecture with a lot of basic analogy ! Thanks a lot!
This is an absolute gem of a video.
This is Gold. I was confused after going through the paper. And boom this cleared it..
Cheers! :D
This is by far the best video to understand Attention Networks. Awesome work !!
Hands down the best series I've found on the web about transformers. Thank you
This is the best resource for an intuitive understanding of transformers. I will without a doubt point everyone towards your video series. Thank you so much!
The best video on Self-attention.
Incredibly well explained! Thanks a lot
I really like the fact that you ask questions within the video. In fact those are the same questions one has and first reading about transformers. Keep up the awesome work!
Amazing video, showing how the attention matrix is created and what values it assumes is really awesome. Thanks!
These videos are really incredible. Thank you!
I don't have words to describe how much these videos saved me, thank you!
have been trying to understand this topic for a long time , glad I found this video now
Blown away by your explanation . You are a great teacher.
it is impressive, you explain so complicated topics in a vivid and easy way!!!
These videos are amazing, thank you so much! Best explanation so far!!
Holy crap, this tutorial is good! I've had GPT-4 generate me so many analogies to refresh my understanding of the same concepts you perfectly explain here.
The best video I've ever watched, thank you so much
Spot on analysis. Many thanks for the clear explanation.
This is very clear and well-thought out, thanks!
Thanks for posting, by far this is the most didactic Transformer presentation I've ever seen. AMAZING!
Educational + Entertaining. Nice examples and figures. Loved it!
Thank you for the video. Best explanation i've seen.
The best video on multihead attention by far!
One of the best explanations on Attention in my opinion.
Probably the best explanation of transformers I’ve found online. Read the paper, watched Yannic’s video, some paper reading videos and a few others, the intuition is still missing. This connects the dots, keep up the great work!
No way. This video is insane!! The most accurate and excellent explanation of self-attention mechanism. Subscribed to your channel!
It´s the most incredible channel on youtube and people doesn't appreciate it :(
This is the best explanation I've ever seen!
Amazing !! loved the explanation! Subscribed
i love this vid so much, now i understand whole multi head self attention thing very clearly thanks!
Your attention to details and information structuring are just exceptional. The Avatar and GoT references on top were hilarious and make things perfect. You literally made a story out of complex deep learning concept(s). This is just brillant.
You have such a beautiful mind (if you get the reference :D). Please consider making more videos like this, such a gift is truly precious. May the force be always with you. 🤘
If only I saw your videos earlier. As everyone in the comments says, these are THE BEST videos on the subject matter found anywhere! Thank you so very much for helping us all!
Cheers! :)
Awesome analogy and explanation !
The best video I ever had! Thank you very much!
Thank you for putting so much effort in the visualization and awesome narration of these series. These are by far the best videos to explain transformers. You should do more of these videos. You certainly have a gift!
Thank you for watching! Yep! Back on it :) Would love to hear which topic/model/algorithm are you most wanting to see on this channel. Will try to cover it in the upcoming videos.
Thank you so much! It's the best Transformer video ever! Really hope more on other models.
Glad to hear that! :) Do let me know if there are certain models that you would like to see covered in future videos.
Awesome and hats off to your conceptual knowledge level understanding
Outstanding explanation and well delivered, both verbally and with the graphics. I look forward to the next in this series
“Part 3 - Decoder’s Masked Attention” is out. Thanks for the wait. Enjoy! Cheers! :D
czcams.com/video/gJ9kaJsE78k/video.html
Your videos are so good at getting complex ideas across in an intuited way. You are like the 3Blue1Brown equivalent for AI. Keep it up and keep producing high-quality video content, at your own pace of course 😋
3Blue1Brown is one of my favorite channels! Therefore, you comparing these videos to that channel is one of the best compliments ever. Thank you! :)
@@HeduAI yes.. this is awesome explanation comparable to 3Blue1Brown.. make more..
Great explanation! Thank you so much!
This is the best explanation ever. Thank you a lot!
Great explanation and visualization, thanks a lot. Please keep making such helpful videos.