Singular Value Decomposition (SVD): Matrix Approximation

Sdílet
Vložit
  • čas přidán 18. 01. 2020
  • This video describes how the singular value decomposition (SVD) can be used for matrix approximation.
    These lectures follow Chapter 1 from: "Data-Driven Science and Engineering: Machine Learning, Dynamical Systems, and Control" by Brunton and Kutz
    Amazon: www.amazon.com/Data-Driven-Sc...
    Book Website: databookuw.com
    Book PDF: databookuw.com/databook.pdf
    Brunton Website: eigensteve.com
  • Věda a technologie

Komentáře • 208

  • @greenpumpkin172
    @greenpumpkin172 Před 4 lety +203

    This channel is so underrated, your explanations and overal video presentation is really good!

    • @dombowombo3076
      @dombowombo3076 Před 3 lety +3

      Don't know why you think it's underrated...
      Everyone who is watching this videos knows how great they are.

  • @ayushsaraswat866
    @ayushsaraswat866 Před 4 lety +129

    This series is by far the best explanation of SVD that I have seen.

  • @AdityaDiwakarVex
    @AdityaDiwakarVex Před 4 lety +34

    SVD was at the very end of my college LinAlg class so I never got a very good understanding of it before the final - this is truly amazing; you say "thank you" at the end of every video but it should be us saying it to you- keep doing your thing! I'm loving it.

  • @smilebig3884
    @smilebig3884 Před 4 lety +36

    The best thing about your lectures is, u do coding implementation along with huge maths.. That makes u different from rest of the traditional instructors. Kudos to you!!!

  • @ris2043
    @ris2043 Před 4 lety +47

    The best explanation of SVD. Your videos are excellent. Thank you very much!

  • @skilambi
    @skilambi Před 3 lety +2

    Please keep making these high quality lectures. They are some of the best I have seen on CZcams and that goes a long way because I watch a lot of lectures online.

  • @alexpujoldartmouth
    @alexpujoldartmouth Před 3 lety +2

    You have a talent for taking complicated topics and breaking them down into digestible pieces. That's the sign of a good teacher. Thank you.

  • @omniscienceisdead8837
    @omniscienceisdead8837 Před 2 lety +3

    you explain math in such a way as to not make someone feel stupid, but feel like their taking steps into understanding a larger concept, and the tools they need are the ones we already have, big ups

  • @nathannguyen2041
    @nathannguyen2041 Před 2 lety +1

    This was, by far, the most compensable explanation of what the SVD is mathematically and visually. The SVD is an incredible algorithm! Amazing how so little you could keep in order to understand the original system.

  • @peymanzirak5400
    @peymanzirak5400 Před rokem +1

    I find everything with these courses, even the way board arranged is just great. Many many thanks for this wonderful explanation and all your effort to make it understandable and yet complete.

  • @douglashurd4356
    @douglashurd4356 Před 3 lety +1

    Superlative production! Lighting, sound, set, rehearsals, material, these videos are among the best productions on CZcams. Even I understood some of it! :-)

  • @AkshatJha
    @AkshatJha Před rokem +1

    What a wonderful way to simplify a complicated topic such as SVD--I wish more people in academia emulated your way of teaching, Mr. Brunton.

  • @zsun0188
    @zsun0188 Před 3 lety

    I learned this in college but couldn't recall a bit after working in the industry over a year. This explanation not only helped me refresh my memory but also enhanced my understanding as well.

  • @wackojacko1997
    @wackojacko1997 Před 11 měsíci +1

    Not an engineer/student, but I'm watching this to get a better understanding of PCA in statistics. I'm going to check the book and research this, but my only complaint (nit-picky) is trying to tell the difference when Steve speaks between "M" and "N" which I know refers to the number of rows or columns of the matrix. But really, this was great and I am thankful that this is something I can study on my own. Much appreciated.

  • @sonilshrivastava1428
    @sonilshrivastava1428 Před 3 lety

    One of the best videos on singular value decomposition. it not only tells the maths but also the intuition. Thanks. !

  • @bnglr
    @bnglr Před 3 lety

    every time I think it's time to pause and comment this video with "awesome", it surprises me with more informative perspective. great job

  • @xiaoyu5181
    @xiaoyu5181 Před 3 lety

    This is also the best explanation of SVG I have seen! Thanks for sharing!

  • @fabou7486
    @fabou7486 Před 2 lety

    One of the best channels I have ever followed, appreciate it so much!

  • @zepingluo694
    @zepingluo694 Před 2 lety +1

    Thank you for presenting us an amazing experience to learn about SVD!

  • @patf9770
    @patf9770 Před 3 lety

    Can't overstate how good this series is...

  • @rajkundaliya7796
    @rajkundaliya7796 Před 2 lety

    It doesn't get better than this. I am so thankful to you. I don't know how to repay this help.... And yes, this is a highly underrated channel

  • @malekbaba7672
    @malekbaba7672 Před 4 lety +1

    The best explanation of SVD i have ever seen !

  • @kaiyueli1372
    @kaiyueli1372 Před 2 lety

    This video series is so helpful!! Thank you Dr. Brunton!

  • @nikosips
    @nikosips Před 4 lety +2

    Thank you very much for those videos , they are very explanatory . Keep up the good work, we need you lessons for our academic improvement.

  • @tusharnandy6711
    @tusharnandy6711 Před 4 lety

    Gentleman, you have done a very impressive job. I have just started exploring data science and have recently completed my college course in Linear Algebra. This was quite interesting.

  • @pilmo11
    @pilmo11 Před 9 měsíci

    superinformative series of SVD

  • @din_far
    @din_far Před rokem

    this is by far the best video explaining SVD on youtube

  • @RajeshSharma-bd5zo
    @RajeshSharma-bd5zo Před 3 lety

    Such a cool concept of decomposition and brilliantly explained here. Big thumbs up!!

  • @kansasmypie6466
    @kansasmypie6466 Před 3 lety +5

    Can you do a series on QR decomposition as well? This is so useful!

  • @eveninrose
    @eveninrose Před 4 lety +3

    Just started watching this playlist, excellent explanations and a great way to promote while sharing knowledge; bought your book and can't wait to revisit w/the text!

  • @yasirsultani
    @yasirsultani Před 2 lety

    These are the best videos out there. Biggest fan Steve, keep it up.

  • @NickKingIII
    @NickKingIII Před 4 lety +4

    Wonderful explanation, clear and easy to understand. Thank you very much

  • @dhoomketu731
    @dhoomketu731 Před 3 lety

    This one's a brilliant explanation. Simply loved it.

  • @garrettosborne4364
    @garrettosborne4364 Před 3 lety

    This is answering a lot of my questions on SVD.

  • @athanasiospliousis2654
    @athanasiospliousis2654 Před 4 lety +4

    Very, very nice explanation and presentation. Thank you!

  • @HuadongWu
    @HuadongWu Před 3 lety

    the best lecture of SVD I have ever seen!

  • @Nana-wu6fb
    @Nana-wu6fb Před 2 lety

    Literally the best svd explained, so meaningful

  • @bryan_hiebert
    @bryan_hiebert Před rokem

    Thank you so much for posting the course material. I was running through asking ChatGPT some questions about eigenvector/eigenvalues and revisiting some linear algebra when I stumbled upon transitional probability matrices or Markov Matrices, PCA and SVD as was getting back to my Data Science studies. This is very exciting stuff and your presentation is very clear and understandable.

  • @Multibjarne
    @Multibjarne Před 2 lety +2

    Explanations like this for a dummy like me makes my life so much easier

  • @carlossouza5151
    @carlossouza5151 Před 3 lety +3

    You are a very very gifted teacher! Thank you for sharing this! :)

  • @btobin86
    @btobin86 Před 2 lety

    You are so talented at teaching, great explanations!

  • @PunmasterSTP
    @PunmasterSTP Před rokem

    Matrix approximation? More like "Magnificent explanation!" I really can't convey in words how absolutely outstanding *all* of your videos are.

  • @saitaro
    @saitaro Před 4 lety +3

    It was pleasure to watch. You should do more educational videos, mr. Brunton.

  • @alek282
    @alek282 Před 4 lety +12

    Amazing lectures, immidiately bought the book, thank you!

    • @LusidDreaming
      @LusidDreaming Před 3 lety

      The book is great, but relatively terse for someone like me who needs to brush up on his linear algebra. These video lectures are an excellent compliment to the book and really help drive home the concepts.

  • @douglasespindola5185
    @douglasespindola5185 Před 2 lety +3

    Gosh, what a class! As mr. Ayush said, this was indeed by far the best SVD explanation I've seen. You've made a such complicated subject way more affordable! I wish you all the best, Steve! Greetings from Brazil!

    • @Eigensteve
      @Eigensteve  Před 2 lety +2

      Thanks so much! That is great to hear!!

  • @YYchen713
    @YYchen713 Před 2 lety +2

    Thank you for making the linear algebra less boring and really connected to data science and machine learning, this series is so much more interpretable than what my professor explains

    • @PunmasterSTP
      @PunmasterSTP Před rokem

      Hey I know it's been nine months but I just came across your comment and was curious. How'd the rest of your class go?

  • @Aditya-ne4lk
    @Aditya-ne4lk Před 4 lety +4

    Just in time for the new semester!

  • @juangoog
    @juangoog Před 2 lety

    Wow, what a wonderful presentation. Congratulations.

  • @arne9518
    @arne9518 Před 3 lety

    This is a gold mine! thanks for your videos

  • @liuhuoji
    @liuhuoji Před 2 lety

    love the video, well explained and aesthetically good.

  • @parnashish1910
    @parnashish1910 Před 2 lety

    Beautifully explained.

  • @chenqu773
    @chenqu773 Před 3 lety

    Good explanation! Many thanks ! how could one manage to get these stuffs explained in such an elegant way.

  • @user-hp1zj6hk5c
    @user-hp1zj6hk5c Před rokem

    really really nice explanation!you are really a great teacher!

  • @patrickgilbert6170
    @patrickgilbert6170 Před 3 lety

    Great video. Should be required viewing for anybody learning the SVD!

  • @kiaranr
    @kiaranr Před 2 lety

    I've read about and even used SVD. But I never really understood it in this way. Thank you!

  • @deepthikiran8345
    @deepthikiran8345 Před 2 lety

    The explanation is really wow !! Very intuitive ... thank you so much !!

  • @mdmamunurrashid2945
    @mdmamunurrashid2945 Před 2 lety

    Love his explanation style

  • @khim2970
    @khim2970 Před rokem

    really appreciate your efforts. wish u all the best

  • @sanaomar2182
    @sanaomar2182 Před rokem

    This is the best explanation ever

  • @FezanRafique
    @FezanRafique Před 3 lety +1

    Steve is magician of explanation.

  • @alexyang6755
    @alexyang6755 Před 3 lety

    it covers a lot.Thanks for beautiful teaching!

  • @maipyaar
    @maipyaar Před 3 lety

    Thank you for this video series.

  • @alwaysaditi2001
    @alwaysaditi2001 Před 24 dny

    Thank you so much for this easy to understand explanation. I was really struggling with the topic and this helped a lot. Thanks again 😊

  • @billandrews6291
    @billandrews6291 Před 3 lety

    13:41 The way I like thinking about is, for example, two vectors in R^3 that are orthogonal are not necessarily orthogonal when projected into R^2, which is essentially what is being done by dropping some of the dimensions. Love the videos though, has me thinking about SVD again.

  • @Streamoon
    @Streamoon Před 2 lety

    Thank you Prof. Brunton, excellent explanation! Just come from MIT 18.06.

  • @guitar300k
    @guitar300k Před rokem

    I like your series also the dark background make my eye feels ease than white background like other channels did

  • @florawoflour4501
    @florawoflour4501 Před 8 měsíci

    thank u so much sir, very helpful

  • @inazuma3gou
    @inazuma3gou Před 3 lety

    Excellent, excellent content. Thank you so much!

  • @mkhex87
    @mkhex87 Před rokem

    To the point. Answers all the important questions. I mean you should come to the party knowing some lin alg but great for intermediate level

  • @ARSHABBIR100
    @ARSHABBIR100 Před 4 lety +1

    Excellent explanation. Thank you very much.

  • @wudiNB
    @wudiNB Před 11 měsíci

    best teacher that l have ever met

  • @opencast1819
    @opencast1819 Před 2 lety

    Great lecture Steve, really enjoyed it! I have a couple of questions: is it better to have longer or shorter time series for the SVD? And is a tall skinny matrix you mentioned speaking about the "economy" SVD only matter for the memory and time savings, or is it generally recommended to have such an input matrix? Thank you in advance and best greetings from Austria) Alexander

  • @hugeride
    @hugeride Před 3 lety

    Just amazing explanation.

  • @mohammedal-khulaifi7655

    you are at the tip-top i like your explanation

  • @katieadamczyk937
    @katieadamczyk937 Před 9 měsíci

    This is a fantastic video!!

  • @fabiopadovani2359
    @fabiopadovani2359 Před 4 lety

    Thank you very much. Excellent explanations.

  • @mohiuddinshojib2647
    @mohiuddinshojib2647 Před 3 lety +1

    This is everything that I need. Thanks for nice explanation .

  • @adelheidgang8217
    @adelheidgang8217 Před rokem

    incredicle explanation!

  • @LyndaCorliss
    @LyndaCorliss Před rokem

    Top rate education, I'm happily learning a lot.
    Nicely done. Thank you

  • @nicholashawkins1017
    @nicholashawkins1017 Před 2 lety

    Lightbulbs are finally going off when it comes to SVD cant thank you enough!

  • @jonathanschwartz7256
    @jonathanschwartz7256 Před 3 lety +1

    Watch out Kahn Academy, Steve Brunton is coming for ya! Seriously though, these videos are fantastic :)

  • @maydin34
    @maydin34 Před 3 lety

    Sir. Just thank you for making me be your student in here for free! Great performance, great job!

  • @MassimoMorelli
    @MassimoMorelli Před 3 lety

    Extremely clear. Just want to point out a fact which at first did not seem obvious to me: the outer product has rank 1 because all the column are proportional to the first vector of the outer product, hence they are linearly dependent.

  • @neurochannels
    @neurochannels Před rokem

    I never *really* appreciated SVD until I saw this video. Mind blown!

  • @harrypotter1155
    @harrypotter1155 Před 2 lety

    Mindblowing!

  • @mr.jizhouwubs7256
    @mr.jizhouwubs7256 Před 2 lety

    Great video in linear space point of view. One naive question: can we make use of Lanczos algorithm such that we can pick up the most significant eigenvalues for approximation in order to circumvent the full diagonalization of the whole large matrix?

  • @lekshmynair3355
    @lekshmynair3355 Před 3 lety

    Thank you too so much sir for this explanation its truely amazing

  • @franciscojavierramirezaren4722

    Thanx amaizing as always👍

  • @JCatharsis
    @JCatharsis Před 2 lety

    Thank you so much professor.

  • @johnberry5275
    @johnberry5275 Před 3 lety

    I'm glad he made it clear that *outer products* were taking place.

  • @regbot4432
    @regbot4432 Před 3 lety

    Wow, you are really good teacher.

  • @namex26
    @namex26 Před 2 lety

    Great lectures. Thanks so much. Kind of hard to distinguish the m's and n's sometimes. Hoped you'd use some other letters :D

  • @akramz2341
    @akramz2341 Před 3 lety

    incredible!

  • @andrezabona3518
    @andrezabona3518 Před 3 lety +1

    for mn ? (For example, what happen if my dataset is composed by 5000 images of 32x32?)

  • @marcavila3938
    @marcavila3938 Před 3 lety

    Even better then the previous one

  • @zhichaozhao172
    @zhichaozhao172 Před rokem

    Prof.Steve, Thanks for your explanations. But what is the difference between the POD and SVD for aerodynamics analyeses?

  • @nolanzheng7810
    @nolanzheng7810 Před 2 lety

    I cant believe I am watching this for free. Thank you!

  • @YasserHawass
    @YasserHawass Před 9 měsíci

    i had some time to accept 1:22 conclusion, since if i understood you right, we have n vector space, in which our data can be, so it should be okay to use the whole n vectors of U as new basis, unless we want dimensionality reduction and not just matrix decomposition, or i'm just missing something?

  • @4096fb
    @4096fb Před 8 měsíci

    Thank you for this great explanation. I just lost you on one point, why is this matrix multiplication equals sig1U1V1T + sig2U2V2T + ... + sigmUmVmT
    Can someone explain how does it complete the entire matrix multiplication? I somehow lost in this columns of U and row of V

  • @aryanshrajsaxena6961
    @aryanshrajsaxena6961 Před 23 dny

    Thank You Professor. Respects from India