Visualize Spectral Decomposition | SEE Matrix, Chapter 2
Vložit
- čas přidán 22. 05. 2024
- A video illustrating the underlying elegant visual interpretation of Spectral Decomposition.
Chapters:
0:00 Chapter 1 Summary
1:23 Symmetric Matrix ?
1:44 Property of Transpose
3:27 Matrix Decomposition
4:58 Eigen Vectors and Eigen Values
8:07 Strong Property of Symmetric Matrix
9:36 Spectral Decomposition
12:03 Visualization
14:13 appreciation
Video Sins:
1. regarding the eigenvectors of symmetric, it is correct to say the eigen vectors are orthogonal if the matrix is full rank. However, the formal definition is there always exist a orthornormal basis which contains the eigen vectors of the symmetric matrix, for details refer to • 25. Symmetric Matrices... , where professor Strang explains the case with eigen vectors with eigen value of 0.
2. 00:50: a diagonal matrix is also a symmetric matrix, and its visual interpretation is very straightforward. So it’s definitely not correct to say every symmetric matrix produces a visually complicated transformation. But normally when we address a matrix as a symmetric, we often mean “symmetric and non-diagonal”, if the matrix is diagonal, we would just call it diagonal matrix.
3. 2:46, the transpose of orthogonal matrix is also a orthogonal matrix. I didn’t mention this fact.
4. 7:42, when the eigen value is 0, it means the vector is in the null-space, pretty important fact, which I didn’t mention.
5. 14:20: the visual interpretation of matrix decomposition doesn’t apply to every type of matrix decomposition. Most matrix decomposition are often used for speeding up computational purposes, for example the LU decomposition.
6. Order of eigen vector could be swap, so there are many alternative decomposition of symmetric matrices.
This video wouldn’t be possible without the inspiration of the legendary 3b1b :
/ 3blue1brown
and the animation software - Manim, which he wrote:
/ 3blue1brown
and the Manim Community:
docs.manim.community/en/stabl...
I literally have zero ideas, why does this series have so less views. This is literally the best extension to 3b1b's Linear Algebra series. This is exceptionally exquisite! Subbed!
EoP (Essence of Linear Algebra) is exactly what inspired this series. I never want to compare anything I make to the legendary 3b1b, but your comment were spot on, I hope this series can somewhat be an informal extension of of EoP. Just like in most college course linear algebra course, the first half focus on things like (vector, range, null space, determinants, linear dependence); the second half of course is almost exclusively focusing on matrix decomposition, and personally I thought the visual interpretation of them were equally valuable hence this series. Appreciate your very encouraging words, did you check out SVD by the way ?
@@visualkernel yes. It was exactly what I needed to know. I always wanted to know why all of a sudden doing the eigen decomposition of AA^T was thought of to calculate the SVD. Now I understand.
He needs to put out more videos. Viewers will come but not with just four videos. He’s got to consistently put them out.. I think he has a ton of potential.
I feel like it's because most intro linear algebra courses only cover the more basic stuff that 3b1b had already covered.
hlw swagato sir, where are you from?? guessing you're A Bengali but from where??
I think 3B1B would be proud. This provides very nice intuition into how to think about spectral decomposition and the role of symmetric and orthogonal matrices in it. Well done, sir! 👏👏👏
thanks buddy !
Probably the best video I've come across explaining this. This not only made SVD crystal clear but also cleared so many other concepts within Linear Algebra not even directly related to SVD. So glad to have come across this. Looks like you haven't uploaded in a couple of years, hoping for new videos!
God fucking damn bro. Even my two brain wrinkles managed to understand the intuition behind decomposition. The most elegant explanation I've ever seen of the subject, and the lead up to it with all the topics was masterful
Brilliant. I don't understand why the geometric interpretation is treated as if it doesn't exist in schools. Thank you a lot!
The music note analogy is such a beautiful way to explain the decomposition of matrix transformations! Amazing video!
this series has just become the best videos I've EVER watched in my life! Never thought I'd cry in the middle of my Uni's library bc i got emotional on how spectacular and genuinely beautiful linear algebra is!
This is literal gold, if you are reading this comment you hit a goldmine congratulations
The best explanation I've seen in 25 years, counting from my first exposure to matrices as a freshman
This may not mean much from a stranger on the internet, but I don't know if I can convey with words how amazing and effective this video is. This is a masterpiece, and it stands far above the numerous math content I've seen (believe me, I've seen a lot). You have a real and rare skill for being extraordinarily concise and intuitive. Keep it up,
This explanation was phenomenal. Great job!
The decomposition of a musical chord into the notes is such a beautiful touch !!! I am lucky I got to your channel.
Amazing, you just explained a concept in 15 minutes that my teacher failed to explain in 4 lectures. Keep being awesome!
Damn this is so intuitive! Its easy to get lost in matrix multiplication but this was a superb reminder for me to just step back and just think of them as geometric transformations. Its actually kind of earth shattering. TY!!
Check out the SVD one , even cooler
This video is beautifully animated and straight to the point. Thank you for illustrating decomposition in such an elegant way.
It took some digging, but I am so glad that I found your videos. These are absolutely fantastic! I really hope that you get more subscribers and that you continue producing content. These videos have been exactly what I needed. Amazing work!
This is absolutely awesome, surprised you don’t get as much recognition; really wonderful video
Really great vid!! So glad I was discovered this channel!!
Very nice presentation. Like a great athlete, you make what you do seem effortless.
Amazing, mind blowing explanation!!!! We need more tutors like you! I wish they taught like this in high school.
love from India, 3blue1brown and you guys really made algebra beautiful; again.
THIS IS SICK! The best explanation I've ever seen on CZcams
It was nice to see the scalings and rotations done step-by-step, very helpful for a better understanding! ty
Brilliant videos that really add to the understanding and intuition of these concepts. As others have said these videos deserve far higher views, and hopefully one day you will find time to make more!
really loved this video!!!! thank you so much!!! made the concept so much clearer!
This is an amazing production. Thanks
One of the best tutorial videos I have ever seen. Thanks
This is such an underrated video about the topic about matrix decomposition! I really like the approach that helps me visualize the meaning of the topic tremendously! Keep up the hard work!!!
This is amazing, thank you for all your high quality videos! Can't believe this has comparatively few views
excellent videos. I am so glad, that I found it. Thank you for a lot of work that you've done to make these excellent visualizations. Also the structure is intuitive and logically ordered. Bravo!
Visualization really helps with understanding. Thank you so much for the great videos
So happy to stumble on these, you got a new subscriber today!
Brilliant! I wish professors emphasized this intuitive understanding more often
Watched this video again, and oh boy its so good!
Excellent video! Would love to see more content like this :)
This video was infinitely awesome!
thank you sooo much for these videos. for some reason I remember/understand concepts so much easier when they have visual interpretations
Most clear and illuminating
Wow! This whole series is so beautiful! First time I understood so many important things!
Thanks a ton Sir. Lot of gratitude towards you for this way of knowledge!
Neo would be proud of these vids. Fantastic job!
Insane visualisations!
Helped me in the understanding of diagonalisation of matrices immensely
Thanks a lot!!
One of the best explanations in linear algebra I have ever seen. Subscribed. Keep up the good work.
Great extension to 3b1b's Linear Algebra series, Thanks so much !!! it really help me build the intuition
thank you so much for introducing me to this. You've made my life easier through your work.
I find this impressive, this concepts are really hard to understand but the order and the way they are explained made very much sense to me! Thank you!
Im feeling kinda sad because i can only found these amazing visually explained videos when i have project at uni.
Amazing videos. So underrated!!
Very clear transparent video. It has also powerful mesmerizing effect. Calming satisfying Yoga-effect😅
So good!!!! Especially your explanation of eigen stuff.
Please keep doing this masterpieces! Thank you!
Really good video man, I was doing the exercises like a robot just applying steps in a specie of algorithm without knowing really the meaning of it. Now I can visualize this transformations and this decompositions in my head, thank you so much
The guitar chord analogy was a nice touch
Amazing explanation. Keep up this good work
Fantastic work, thank you for this
The logic flow renders much more understanding than other 'visual course', particularly about the eigenvector!!!
Thank you for this video. Thank you very much. It's awesome. I want more of your videos.
Thank you so much for this video it really helped me better understand the concept!
these videos are amazing，Thank you for sharing this with us.
Amazing. I am stunned. Thank you.
Thanks for these kind of content, I feel by having these kind of content you are helping people to understand power of mathematics and help apply these concepts which otherwise need tedious study of mathematical formulas , which helps people like us to bridge the gap to understand other applied solutions from these basics. Keep it up , world is converging and future solutions can only be solved when more people understand the basics intuitively and apply to solve new problems of world
extremely well done, keep this up because college students with bad linalg professors truly appreciate the content.
This is great! I took a course in Operator Theory and for the life of me couldn't visualize the spectral theorem in any intuitive way. I wish I found this video months ago!
really supreme video! thanks a lot!
Holy crap, the Manim animations are incredible. I want to use Manim for my own channel for unrelated to math topics, and I am going to take inspiration from your style. It's probably the best I've seen aside from 3B1b.
very helpful. thank you. never expect math can be so easy to understand.
love this videos...they´re so helpful......thanks man.....keep doing it......by the way, the chords detail was pretty nice....
Dude I think this might be my first comment on youtube, but you deserve it haha. This series got me understanding matrices at a level even deeper than youtube-linalg's godfather 3blue1brown:) You ROCK! and dope logo you got for your channel! keep it up, I'll be there;)
Thank you so much for your help!!!
3b1b should shout this out man. Legend
this is fantastic!
Video is transformative
A pretty much under-appreciated course on LA
Beautiful video, i was amazed about the quality and how good the explanations and vizualisations were!
I dont see the chapter 1 part anywhere, is there only supposed to be the chapter 2?
Yo this vid might of just saved for my finals thx düd
Beautiful!
Thank you so much.
Thank you very much!!! Hope you will find the time to make more video's:) You helped me a lot!:)
It is interesting how I make this kind of video while expecting to be seen by no one. But youtube recommendation algorithm just does interesting things, leading people to the edge of the internet. And I am very glad if it could have offered an alternative perspective on how we view matrix decomposition. SVD coming out soon, that will be a good one.
@@visualkernel
Why expecting to see by no one ? I personally really like math videos and these are really great and definitely give good fight for 3blue1brown
@@omridrori3286 Well, this video is currently not advertised, and finding a video like this is pretty challenging. (I actually tried to CZcams search "Visualize Spectral Decomposition" explicitly, and my video does not even come out ). So I think it's very interesting how you landed on this piece of recommendation. And about 3b1b ... I think everyone who makes math video can only asymptotically approach the half of what he is. Thank you Omri, for your words of encouragement.
@@visualkernel
When i really wait for that every day i check please i really want to know svd
Brilliant! 👏👏👏
Very nice, thank you very much:)
This actually complements some of the illustrations 3B1B didn't demonstrate.
Keep up great work man, I hope you can release more😢
I love these videos! I've watched 3Blue1Brown linear algebra videos. They are good but more conceptual math. These videos show how to implement linear algebra to computer graphics. I'm lucky to find it when I search svg
Great video
Thank you so much sir :)
brilliant!!
Brilliant!
Respect for you
Excellent
Bro just keep making these vidoes and the views will eventually come, it is literally inevitable!
This has gotten me to see the linear transformations of these "sandwich" estimators. I wonder how we can visualize econometric estimators like the basic OLS (X'X)^-1X'Y and it's covariance matrix (X'X)^-1(X'e')(eX)(X'X)^-1 and even longer matrix multiplication models.
Thanks
sublime
Please, continue this series. Make about PCA !!!
I now understand why many people do not like math. Because they didn't see videos like these.
Amazing video, fantastic job. Small mistake - at 14:50, the labels for Q and L are incorrectly swapped - L is labeled as the eigenvector matrix and Q is labeled as the eigenvalue matrix, but the reverse is correct.
yes . Eigenvalues scale. Eigenvectors rotate.
Around 4:00, the parallels between decomposing a matrix into simpler operations and decomposing a chord into its notes.. 🤯
Is this the Legendary Vinam Arora himself ?
@@visualkernel Ye buddy absolutely loved the video!
3:11 , can't stop laughing from the 3B1B reference of pi...😂
Nice video mate just wanted to know how did you get the conceptual knowledge
Fantasic
Great