Graph Neural Networks - a perspective from the ground up
Vložit
- čas přidán 2. 06. 2024
- What is a graph, why Graph Neural Networks (GNNs), and what is the underlying math?
Highly recommended videos that I watched many times while making this:
Petar Veličković's GNN video → • Intro to graph neural ...
Michael Bronstein's Geometric Deep Learning keynote speech (beautiful!) → • ICLR 2021 Keynote - "G...
Xavier Bresson's Graph Convolutional Networks lecture → / iiv9r6bjxh
3Blue1Brown’s series on Neural Networks → • But what is a neural n...
If you'd like to go further with GNNs, do get started with Petar's wonderfully compiled list of resources to continue → goo.gle/3cO7gvb
Here's also another awesome compilation, to go further with research → github.com/GRAND-Lab/Awesome-...
Also, the GNN literature is growing so quickly so subscribe to this Telegram channel by Sergey Ivanov to help you keep up → t.me/graphML
Reference blog posts about GNNs:
Michael Bronstein → towardsdatascience.com/geomet... (a must-read), towardsdatascience.com/do-we-...
Amal Menzli → neptune.ai/blog/graph-neural-...
Eric J. Ma → ericmjl.github.io/essays-on-d...
Rishabh Anand → / an-illustrated-guide-t...
(More recent) Distill → distill.pub/2021/gnn-intro/, distill.pub/2021/understandin...
Special thanks to:
Seb, Rish and Jet for reading drafts of this and giving such amazing feedback.
Serene for helping enhance production decisions like design, color, animation flow, time-management for my editing and recording (hahaha), and others.
Jay and Malcolm for being there and encouraging the decision to do this video.
Literature References:
Recommended survey → Wu et al. 2020
Convolutional GNN layers → Defferard et al. 2016; Kipf & Welling 2016
Attentional GNN layers → Monti et B 2017; Veličković et al. 2018
General Message Passing GNN layers → Gilmer et al.2017; Battaglia et al 2018; Wang et B 2018
Halicin → Stokes et al., Cell 2020
-----------------
Timeline:
0:00 - Graph Neural Networks and Halicin - graphs are everywhere
0:53 - Introduction example
1:43 - What is a graph?
2:34 - Why Graph Neural Networks?
3:44 - Convolutional Neural Network example
4:33 - Message passing
6:17 - Introducing node embeddings
7:20 - Learning and loss functions
8:04 - Link prediction example
9:08 - Other graph learning tasks
9:49 - Message passing details
12:10 - 3 'flavors' of GNN layers
12:57 - Notation and linear algebra
14:05 - Final words
------------------
Music by Vincent Rubinetti
Download the music on Bandcamp:
vincerubinetti.bandcamp.com/a...
Stream the music on Spotify:
open.spotify.com/album/1dVyjw...
------------------
Thanks for watching this, and I really hope it was helpful!
A quick introduction - I'm Alex from Singapore, a PhD student at NUS working on machine learning, computer vision and (I guess of course) GNNs for medical imaging and healthcare applications.
I've recently been thinking about doing explainer videos about machine learning or tech, and have always found great value in visual animations of math concepts.
So, thanks Grant Sanderson, James Schloss and the 3b1b team for organizing SoME1 which pushed me to pick up After Effects, research, script and put this together over the past month.
If you have questions or want to connect (please do!), you can:
Find me on Twitter → / alexfoo_dw
Find me on LinkedIn → / alex-foo - Věda a technologie
OUTLINE:
0:00 - Graph Neural Networks and Halicin - graphs are everywhere
0:53 - Introduction example
1:43 - What is a graph?
2:34 - Why Graph Neural Networks?
3:44 - Convolutional Neural Network example
4:33 - Message passing
6:17 - Introducing node embeddings
7:20 - Learning and loss functions
8:04 - Link prediction example
9:08 - Other graph learning tasks
9:49 - Message passing details
12:10 - 3 'flavors' of GNN layers
12:57 - Notation and linear algebra
14:05 - Final words
This is by far the best introduction to GNNs in CZcams today. I habe seen many of them. Congratulations and thank you!
From the correct level of mathematical precision, to the pedagogy of the content and up to the voice of the speaker. It all fits like a charm. Chapeau!
Too kind! Thanks so much :)
7 Months later i can just agree to every point of that. Wonderful
Really great job and great animations. What tools do you use to make all these animations? Must be very time consuming
Yes this is the best video on graph neural network BY FAR!!
Only one video on this chanel? Come on. This is top quality content. I would definitely watch anything that gets published there.
Today, I understood Message Passing very well. Amazing interactive explanation. People like you make life easier. Thank you, Alex.
Thanks for the kind words! Glad this helped you :)
Amazing how you managed to include so much information in a relatively short video without compromising the depth of explanation. Subscribed and hoping for more content in future.
Best introduction tutorial on GNNs. Many tutorials throw statistics around as an explanation but very few provide the intuition behind it. Well done.
Such a lovely content man! I was having trouble understanding GNNs from other sources, but only your animation made it crystal clear in one go. Cant be thankful enough. Hope you keep making such wonderful explanatory videos on other topics in ML.
Amazing introduction to GNN's, summarizing all the important basics in a beginner-friendly fashion while providing very helpful visuals
Thanks for the kind review! Glad you found this useful :)
Crazy amounts of work has been put into this video. The simplicity was the cherry on the top. Thanks a ton. Gained a new sub.
Such a great explanation for GNN. The examples are easier to understand so that I could clearly get the concept right!! Thanks for the wonderful video!!
Bro, you nailed it! This type of explanation is what we need. You are a legend
Cleverly explained, beautifully animated! Great job!
What an amazing explanation, wondering if you are going to add further on this line .if so ,looking forward for this moment.big thanks
Thanks so much! Glad you found it helpful :) yes I intend to try different topics and different video lengths soon!
Beautifully made and explained, MORE!!
Great explanation and illustration.
dude, the effort you put into this is amazing! Thank you
Absolutely amazing video! Subscribed.
Amazing and well done video! Thank you for sharing!
Your video is amazing. Well explained with beautiful visualizations. Thanks a lot.
The best high level explanation I've found, thanks!
Very clear explanation. Perfect work!
Amazing content...probably the best one which I have watched till now for GNN
very good explanations. cleared all the doubts, thanks
Spectacular work!
Appreciable introduction to make concept totally clear. Keep up the good work !!
Very clear explanation of the high level concepts with a remarkably understandable example!
great introduction & the animation helps a lot! thanks Alex!
This is fabulously done; the low-level explanation of the CNN analogy and layer's function expression and then abstracting that to a generalised function expression as seen in research papers. Thank you so much!
That is the best video explain the GNN and the more intuitive i have seen, thank you a lot.
Thank you for the great explanation, Alex. I’ve only just heard of GNNs in recent days and you have clarified things for me. They appear to be very efficient. 👍🙏
Alex! Until I watched this video I felt like I was scrambling my brain trying to understand GNNs. Thank you for the gorgeous and clear explanation.
You have a gift Alex. Thanks for this beautiful explanation. I hope you continue your amazing work.
Amazing way of explaining it, the animations helped a lot, GREAT JOB! Thanks a loooooooooot.
Magnificent, spectacular presentation, helped a lot in all aspects of my studies.
Thank you ,sir. This has been the most helpful GNN video for me.
Wow, very good explanation. Thank you!
Your video deserves millions of views. SEO your video properly and you will get that. best of luck.
indeed
Thanks for your kind words! Happy this was helpful :) any tips for SEO would be appreciated!
We need more videos like this!
This is amazing, I can't tell you how much I needed this to see exactly where my models are messing up. Thank you😭!
best video so far on the topic of graph neural networks.
Great Video, Simple and easy to understand! appreciate the efforts taken!
That's a very impressive way to explain graph nn ... Well done!
Thanks for the simple explaination of GNN
this is the most fun and informative video about GNN
Alex! Thank you for this video!!!
Really helpful visual stimulations! ✨
Thanks Serene!!!
one of the best intros to GNN i found on youtube 👍👍
amazing explanation, we would love a series on graph neural networks from you.
This is amazing!! I sincerely hope you make more!
Thank you! Glad you found this helpful :)
I'm writing a master thesis where I'm going to use graph neural networks to calculate traffic flow, so grateful for this thanks Alex!!
Sound awesome! Glad this was helpful, Richard!
So good! so well done, and clearly explained!
really great and detailed explanation. Amazing graphics and text. Please do more !
That was my best presentation video that ı've ever watched. Thanks for everything.
Thanks Alex. I'm not a Maths person, yet I enjoyed your video. Looking forward to learn from basics from you 🙏
This is the best GNN explainer I've seen. Thank you so much for this! Just one question: What did you use for the animations?
Wow. This is one of the best videos I've seen. Thank you for putting the effort into the helpful animations too.
Just noticed that this is your first video. you have a gift! please keep making more
What a lucid explanation to a complex topic. Take a bow..
Best GNN video out there!
It's a shame you didn't make more videos, this is like the 3Blue1Brown of NN. Best video on GNN i have ever seen.
Nicely done! Well illustrated that keeps the learning interesting 👍
Thanks Jia Hao!!
bro this is the best introduction of gnn I have ever watch.
This was a terrific video, thanks. I hope it gets more views.
This video is very well done thank you!
This is the best gnn video i've seen
Best explanation I've found sofar on this topic. We need more videos from you!
Thanks for the kind words!
Easy explained but still has good depth. Pinnacle of good edu videos.
Keep them coming Alex. An amazing explainer. Hats off.
Thank you for your kind words!
This is best video on GNN for beginners
That is a perfect introduction. And what a fascinating topic. Thanks :)
This an extremely nice video. Thanks you
Great video! I hope to see more :)
Really helpful, Good clean explanation👌. Thanks
Thank you! So glad you found this helpful :)
best expaination for GNN, Thanks for the video 👌
This video was incredibly helpful. Thank you.
Glad you found this helpful! Thanks for the positive feedback :)
thank you so much for this video! helped me a lot to understand GNNs for my report
I spent like a week reading all the papers and now I stumble upon this video. God I wish I watched this before
Glad this was helpful! The paper reading will definitely pay off haha
Man where are you.... we need videos from you
Great job w the animation! It makes the topic easier to understand 💯
Thanks filmmaker Elton!!
Great video! Keep up the good work!
What an honor! Thanks so much, you guys are an inspiration! :)
You did an amazing job. I was wondering why did you stop making such videos . If possible please continue doing so
Wow what a nice work! Must have put much effort in this! Thanks for sharing
I still struggle a bit to understand, but I will rewatch it
Great analysis
A new star is born 🌟 good job Alex, with thanks.
Hahaha too kind, thank you! Glad this was helpful to you :)
Really great video and very clear explanation! If you don't mind me asking, may I know what software do you use to create the animation? Thanks!
Thank you! Glad you found it clear :) I used After Effects for all the animations, and Illustrator for the objects
Amazing, simply...
The best explanation on CZcams!!!
Thank you! Glad you found it useful :)
Great video!!!!! I could even understand it
Wow!! Keep this great work going!! ❤🚀
Thank you! Glad you found this helpful
Wonderful! I use perceptrons / multipreceptrons and finally getting into GNN. You have a wonderful explanation! Thank you so much. I am very interested in GNN classification and anomaly detection
Thank you! Glad you found this helpful :) ah yes anomaly detection is very appropriate for GNNs, do pursue it further!
Great video!
Amazing explanation. We have lots of hope from Alex. All the best.
Thanks so much for the kind words! :) Glad you found this helpful
Hey, this video is amazing! I hope to see more videos from you :)
Really great explanation. GNNs seemed hard 15 min back...Thanks a lot!
very good video. please do more on GNNs. thank you!
Cool infographics man!! And nice explanation.
What do you use to create such animations
Thank you!! Glad you enjoyed this. I used After Effects for all the animations :)
really good explaination. keep making the videos like this your work is good.
Thanks so much! Glad that this was helpful
It's amazing explanation with visualization, really worth like share and subscribe, thanks for sharing such explanation and appreciated your efforts
Hey your way of explaining it is very simple and beautiful 🤩.. Please make more videos like this 🙏🏻 you are too good 🔥
You’re too kind, glad you enjoyed it!
good explanation!
Great video! You saved my life, thousands tons of love from Vietnam
Lovee your pho