Curse of Dimensionality Easily explained| Machine Learning
Vložit
- čas přidán 9. 06. 2019
- The curse of dimensionality refers to various phenomena that arise when analyzing and organizing data in high-dimensional spaces that do not occur in low-dimensional settings such as the three-dimensional physical space of everyday experience.
#CurseofDimensionality
Please subscribe the channel for more interesting content.
You can buy my book on Finance with ML and DL from amazon.in
url: www.amazon.in/Hands-Python-Fi...
I have a perfect example.....my instructor gave me a 2.5-hour lecture on this finally m confused but in 7 min video you made it clear. It's a Curse of Dimensionality.........great.
Could we select the features using the l2 regularization coefficients; which helps us to select the right features which are not shrinked? By that can we reduce the curse of dimensionality?
How do u we know what is threshold value of features selection?
Please make a video on the math behind t-SNE.... Great video!! Thank you
Watched it for second time for better understanding and coding practice. Thanks
Eagerly waiting for your next video. Please upload soon.
simply explained.. thank you Krish
This was a great video explained very easily!
Thanks you much bro.. waiting for your next video
sir thanx for the video i am new to the scenario of machine learning and this helped me
Very well explanation. Easy to understand.
Thanks for explaining clearly sir..
Great explanation Krish. No need to make notes .Just understand. Thanks
In a very simple term, if you are working with large number of dimensions the pattern discover is challenging, this is what the curse of dimensionality.
Well explained! Thanks
Is it necessary that the curse of dimensionality happens when the no of features increased exponentially ?
Thank you for this simple explanation :)
Thanks Krish
Great
kindly do video on Chunking and Lazy Learners method
Thank You
Thank you bro
Can you please make a very on OLPP?
Basically diminished returns?
What does accuracy here mean? Does it mean the ability for the model to predict?
Yes
Thanks for the effort. But what you explained is not curse of dimensionality it is simply increasing the model parameters which leads to overfitting. Whereas curse of dimensionality talks about high-dimensional data which their distance distribution gets independent of the data.
Hello my dear friend. I think you got confused between overfitting, underfitting and curse of dimensionality. Overfitting and underfitting usually happens when you dont select the right hyperparameter for the machine learning algorithm that we are using. Here we are discussing about attributes,features. Today i will also be uploading a video on overfitting and underfitting.
Thanks
Krish
@@krishnaik06 No I am not confused. When you have more features it means your models needs more parameters therefore you increase the complexity of your model this leads to over fitting when you have few training data. The solution is either regularizing the parameters or reducing the dimension. (off course increasing training data helps). Curse of dimensionality is a different subject please at least see the wikipidia page : en.wikipedia.org/wiki/Curse_of_dimensionality
@@skyman7290 the predictive power of a classifier or regressor first increases as the number of dimensions or features used is increased but then decreases,[4] which is known as Hughes phenomenon[5] or peaking phenomena........from your given link I have got this, Kindly check the article first before commenting on Krish's video. Peace!!
@@krishnaik06 is it only that the right hyperparameter is responsible for underfitting and overfitting not selecting the right features are responsible
One concern: When you are using the word exponentially, you are using it wrongly. The exponential increase required for ensuring reliable modeling is in the sampling size and not the number of features. Thank you for the good illustration though. Time: 5:55
same doubt tbh ++
I have a perfect example.....my instructor gave me a 2.5-hour lecture on this finally m confused but in 7 min video you made it clear. It's a Curse of Dimensionality.........great.