UMAP Uniform Manifold Approximation and Projection for Dimension Reduction | SciPy 2018 |

Sdílet
Vložit
  • čas přidán 9. 07. 2024
  • This talk will present a new approach to dimension reduction called UMAP. UMAP is grounded in manifold learning and topology, making an effort to preserve the topological structure of the data. The resulting algorithm can provide both 2D visualisations of data of comparable quality to t-SNE, and general purpose dimension reduction. UMAP has been implemented as a (scikit-learn compatible) python library that can perform efficient dimension reduction, scaling out to much larger datasets than t-SNE or other comparable algorithms (see github.com/lmcinnes/umap).
    See the full SciPy 2018 playlist here: • SciPy 2018: Scientific...
  • Věda a technologie

Komentáře • 56

  • @kentvandervelden
    @kentvandervelden Před 6 lety +11

    Wow, fantastic talk!! Trying out several ideas from the talk immediately.

  • @MegaStatis
    @MegaStatis Před 5 lety +13

    Thanks for the nice and clean explanation for UMAP!

  • @FougaFrancois
    @FougaFrancois Před 5 lety +1

    I will be trying that shortly! Fantastic ideas !

  • @jukebox54
    @jukebox54 Před 6 lety +22

    Thanks for the Python implementation!

  • @shakedg2956
    @shakedg2956 Před 3 lety

    Loved the talk! Thank you!

  • @dwinsemius
    @dwinsemius Před 4 lety +4

    Nice explanation of connection between topological notions and algorithm implementation.

  • @soothingTrench
    @soothingTrench Před 6 lety +4

    Amazing talk

  • @inflivia
    @inflivia Před 3 lety +1

    Cool talk, well delivered.

  • @9164312
    @9164312 Před 5 lety +6

    Amazing,Genius!!

  • @matveyshishov
    @matveyshishov Před rokem

    Loved it so much, thanks!

  • @kvafsu225
    @kvafsu225 Před rokem

    Very illustrative presentation. Thanks

  • @NoNTr1v1aL
    @NoNTr1v1aL Před 3 lety +1

    Amazing video!

  • @mishalthapa4643
    @mishalthapa4643 Před rokem

    wonderful and informative presentation!

  • @unoqualsiasi7341
    @unoqualsiasi7341 Před 5 lety +1

    Amazing, thanks!

  • @almeidaalin3
    @almeidaalin3 Před 4 lety

    very clear, thank you!

  • @avacdoos3101
    @avacdoos3101 Před rokem

    Amazingly Explained

  • @phpngpl
    @phpngpl Před 5 lety +2

    You are a great golfer.

  • @user-sv5vb1mj1q
    @user-sv5vb1mj1q Před 4 lety

    great success, my congrats

  • @itsme.junaway
    @itsme.junaway Před 5 lety +10

    This is too good to be true!

  •  Před 5 lety +15

    Greatest ML innovation of the last decade.

  • @maziyarbaranpouyan3543
    @maziyarbaranpouyan3543 Před 6 lety +3

    Perfect Talk!!!

  • @AnIceCrasher
    @AnIceCrasher Před 4 lety

    Supercool, thank you :D

  • @ValeryKhamenya
    @ValeryKhamenya Před 3 lety

    Brilliant!!!

  • @ProfessionalTycoons
    @ProfessionalTycoons Před 6 lety +1

    amazing

  • @asishswain1259
    @asishswain1259 Před 3 lety

    incredible !

  • @ryanbae9563
    @ryanbae9563 Před 5 lety

    Good talk.

  • @MaskedPixel
    @MaskedPixel Před 5 měsíci

    Yup. Using this one tomorrow.

  • @endingalaporte
    @endingalaporte Před 4 lety

    very very very nice thank you so much

  • @BadGatewayMusic
    @BadGatewayMusic Před 5 lety

    fantastic

  • @kelixoderamirez
    @kelixoderamirez Před rokem

    permission to learn sir. thank you

  • @aug_st
    @aug_st Před 4 lety

    Brilliant

  • @jaritos675
    @jaritos675 Před 5 lety +1

    Does anyone have a reference for the triplet networks he talks about?

  • @kochasaito4628
    @kochasaito4628 Před 4 lety

    The Singular simplices also permitted, but the homotopy quotient is required there.

  • @vedantsrivastava5754
    @vedantsrivastava5754 Před 5 lety +8

    I am using the UMAP for Dimensionality Reduction. It's implementation really bods well with my data. I have a question regarding the feature importance. Suppose, after the dimensionality reduction, the UMAP separates out the labels clearly and creates the 3 subgroups containing all labels. Can I somehow get the list of features corresponding to each group? Which features were more relevant to
    which group?

    • @lelandmcinnes9501
      @lelandmcinnes9501 Před 5 lety +7

      One option that I have seen done is to build a classifier based on the clusters and then use SHAP or LIME to get interpretations of what separates the clusters.

    • @vedantsrivastava5754
      @vedantsrivastava5754 Před 5 lety +1

      Thanks @@lelandmcinnes9501 , it is really helpful. Now I am looking for features contribution to each classes ? Does the earlier question of mine make any sense? With tuning the different hyperparamter , I will get different groups...Does these 2 dimensional cluster have any meaning of original features?

  • @argolo9512
    @argolo9512 Před 4 lety +1

    Whats new about UMAP as compared to other TDA methods? The approach is just like Gunnar Carlson's mapper

  • @shubhamtalks9718
    @shubhamtalks9718 Před 2 lety

    Wow!

  • @weiguo9183
    @weiguo9183 Před 9 měsíci

    Does anyone know which kind of normalized distance is used in 11:29?

  • @kochasaito4628
    @kochasaito4628 Před 4 lety

    How deal with the obstruction?

  • @a.opterix3576
    @a.opterix3576 Před 2 lety +1

    Do we know why it is the case, that the local connectivity assumption solves the curse of dimensionality?

    • @marcomoreno6748
      @marcomoreno6748 Před 5 měsíci

      Does anyone have something they'd like to share on this question?

  • @Level6
    @Level6 Před 3 lety +1

    19:10 t-sne vs UMAP

  • @chitralalawat8106
    @chitralalawat8106 Před 4 lety

    The sinosuidal type wave only comes if you've 2D data.. & I think when you started, you said that it's a high dimensional data?

  • @just4onecomment
    @just4onecomment Před 3 lety

    Why does he say the "distributions look nice" at 12:10 ? They look pretty close/overlapping and indistinguishable to me

    • @xy9439
      @xy9439 Před 2 lety

      That's the point

  • @user-mv3im2fi4f
    @user-mv3im2fi4f Před 2 měsíci

    Comecei sem entender nada, terminei sem entender nada e mais um pouco

  • @tinakeshav1576
    @tinakeshav1576 Před 3 lety

    Why are we taking 20 nearest neighbours? ~ 12:00

  • @aug_st
    @aug_st Před 4 lety

    Never using tSNE again 😎

  • @frankdimeglio8216
    @frankdimeglio8216 Před 3 lety

    THE ULTIMATE, THE CLEAR, AND THE TRUE MATHEMATICAL UNIFICATION REGARDING PHYSICS/PHYSICAL EXPERIENCE IS PROVEN:
    Time DILATION proves that electromagnetism/ENERGY IS GRAVITY, AS E=mc2 is DIRECTLY and fundamentally derived from F=ma. Indeed, gravity/acceleration involves BALANCED inertia/INERTIAL RESISTANCE; AS ELECTROMAGNETISM/energy is gravity. Therefore, the rotation of WHAT IS THE MOON matches it's revolution. Moreover, objects fall at the SAME RATE (neglecting air resistance, of course); AS ELECTROMAGNETISM/ENERGY IS GRAVITY. (Gravity IS ELECTROMAGNETISM/energy. "Mass"/ENERGY IS GRAVITY. ELECTROMAGNETISM/energy is gravity.) E=mc2 IS F=ma. The stars AND PLANETS are POINTS in the night sky. (Very importantly, outer "space" involves full inertia; AND it is fully invisible AND black.) INSTANTANEITY is thus FUNDAMENTAL to what is the FULL and proper understanding of physics/physical experience. This NECESSARILY represents, INVOLVES, AND DESCRIBES what is possible/potential AND actual IN BALANCE, AS ELECTROMAGNETISM/ENERGY IS GRAVITY. SO, time is NECESSARILY possible/potential AND actual IN BALANCE; AS ELECTROMAGNETISM/ENERGY IS GRAVITY. BALANCE and completeness go hand in hand. Thoughts are invisible. THINK. NOW, the INTEGRATED EXTENSIVENESS of THOUGHT (AND description) is improved in the truly superior mind. INDEED, the ability of THOUGHT to describe OR reconfigure sensory experience is ULTIMATELY dependent upon the extent to which THOUGHT IS SIMILAR TO sensory experience. I have explained the fourth spatial dimension, as E=mc2 IS F=ma; as this then also explains the significance of c4. Gravity IS ELECTROMAGNETISM/ENERGY. It is proven. Again, BALANCE and completeness go hand in hand. It ALL CLEARLY makes perfect sense. Great !!!
    E=mc2 IS F=ma. Very carefully consider what is the Moon. I have explained perpetual motion. The planets are not falling in what is "curved" "SPACE" in relation to what is the Sun. SO, a given PLANET sweeps out equal areas in equal times; AS E=mc2 IS F=ma. Consider the man who is standing on what is the Earth/ground. Touch AND feeling BLEND, AS ELECTROMAGNETISM/ENERGY IS GRAVITY. OVERLAY WHAT IS THE EYE in BALANCED RELATION to/with what is the Earth. E=mc2 IS F=ma. LOOK at what is the translucent, semi-spherical, AND BLUE sky. The Earth is ALSO blue ! Great. It is ALL CLEARLY proven. ELECTROMAGNETISM/energy is gravity. Gravity IS ELECTROMAGNETISM/ENERGY. Gravity/acceleration involves BALANCED inertia/INERTIAL RESISTANCE, AS E=mc2 IS F=ma; AS ELECTROMAGNETISM/ENERGY IS GRAVITY. Again, the stars AND PLANETS are POINTS in the night sky. Great !!! BALANCE and completeness go hand in hand. THINK !!! "Mass"/energy is gravity. ELECTROMAGNETISM/energy is gravity. The tides NECESSARILY constitute a BALANCED electromagnetic/gravitational manifestation, form, or effect. In fact, stellar clustering proves that electromagnetism/ENERGY IS GRAVITY.
    By Frank DiMeglio

  • @chilliking3424
    @chilliking3424 Před 3 lety

    fantastic

  • @uzulim9234
    @uzulim9234 Před 3 lety

    amazing