How do random forests work? Decision trees video: • Decision Trees Decision tree pruning video: • Decision Tree Pruning Overfitting video: • Overfitting
Great video. 1) Spoke well and explained the concepts clearly 2) Threw and caught the marker every time, with no interruption in speech while doing so. Bravissimo!
I'm studying Data Science at MIT, you really can't imagine man how much "ritvikmath" is helping me, and a couple more channels, before I start any topic I like to tackle it first or just take a general idea, and you can't imagine how much your videos helped! Short, concise, and to the point! Thank you man 🙂 Just one notice, It might be a good idea to choose an easy to remember / clear channel name, sometimes when I'm talking to someone, it is almost impossible to remember the name of your channel, just a clear name with spaces! Thank you again 🙂
Very well organized and well put together. Simplified enough for the medium, but included just the right amount of detail to guide one in their further pursuits of the topic. Thank you.
I'm trying to learn some ML content as it relates to classification to quite a large degree, and just want to say that this video on Random Forest is one of the only ones that actually made sense to me as a layman! Thank you
Wow great explanation - I am hooked on these videos. Get the main points in a short timeframe - would be nice to have a video on Tuning RF and other ML algorithms. And the pre-req videos are very useful to have the right background to understand this one. Thank you!
Loved the interpretability of the random forests idea! Very clever / useful. I'm guessing that you would want to reshuffle the dth feature for each i to avoid the effect that the shuffled data accidentally correlates with an important feature.
Ritvikmath, i would like to complement you with the clear direct explanation video's. you make it easily accessable and clear with practical examples. please keep it up. Kind regards, Jan Pieter Wagenaar
Thanks Professor , your explanation is very good. I am really enjoying your videos and they are helping me to focus on DS. I have seen many videos prior they only mention Idea 1 - Bagging and say it is Random Forests. But you have mentioned Idea 2 - Random Subspaces as well. Just to confirm on it , do the Random Forests use both the ideas ? Do you mean that Bagging + Random Subspaces = Random Forest ? If possible can you explain how to code it ? Thanks for your time on videos ! Many of your videos are good , even your Bias-Variance video is also super.
Yo I heard the RF is bad alone and needs help when: 1) a strongly predictive linear feature exists in X. You gotta help the RF out by either feeding it the residuals from running the linear model on that feature first, so each model in the ensemble can do what it does best, the linear doing linear things and the nonlinear RF doing nonlinear things. Or else just preprocess to create an additional feature which is just the output of the linear model, and give the whole augmented feature set to the RF now. 2) 2nd order associations are expected to be important, because despite its subsampling of feature space, the RF is actually NOT good at automatically finding 2nd order predictive associations in X. THus we should help the RF out by doing some feature engineering of the 2nd order terms in advance into the X and then give it to the RF NOW. Further it might help still more by telling RF to stop using the typical 0.5 ratio default of subspace sampling and instead just focus on exactly 2 columns at a time, no more, no less, forcing it to look much closer at all the 2nd order associations that you expect should be found by the RF. These are hear-say and hypotheses. It would be cool to see how to do it in sklearn's pipeline on a dataset like "jewellery" which is used for demo code by the pycaret library. Jewellery has a strongly predictive feature "carets" or "weight" in its X. But they just look at trees alone in their model search, so I think it can be improved by helping out the fancy nonlinear tree models as described above.
I think that it's since we're trying to focus specifically on the importance of each feature to the model. We're avoiding adding the additional variable of how well the model generalizes and therefore works on the test data so we can see the features' contribution to the model's accuracy under ideal conditions.
u r incredibly amazing ,but i have 2 questions : 1- What is the meaning of when i use all features the tree will be correlated to each other, i know what is the meaning of 2 features are correlated ,but what is mean when i say 2 trees are correlated ????? 2- when i need to determine how much a specific feature is important now , i trained the model using 80% of the dataset and now do i get the accuracy of this (80% dataset) of the dataset and after that shuffle my specific column and get the accuracy again of 80% of the data after shuffling then subtract them ? or i'm using 20% for both ? but u said in the video u r get the accuracy of the data that made that tree so u almost talking about the 80% , it make no sense for me using 20% of the dataset
Can't we get the feature importance for free, without permuting, by looking at the accuracies of models trained with and without certain features (in the random subspace step)?
2-hour lecture in 15 minute. ritvik rocks.
i swear
I swear
1 semester in 15 minutes :)
Great video.
1) Spoke well and explained the concepts clearly
2) Threw and caught the marker every time, with no interruption in speech while doing so.
Bravissimo!
This is the best video to understand random forest in CZcams so far for me :))
I'm studying Data Science at MIT, you really can't imagine man how much "ritvikmath" is helping me, and a couple more channels, before I start any topic I like to tackle it first or just take a general idea, and you can't imagine how much your videos helped! Short, concise, and to the point! Thank you man 🙂
Just one notice, It might be a good idea to choose an easy to remember / clear channel name, sometimes when I'm talking to someone, it is almost impossible to remember the name of your channel, just a clear name with spaces! Thank you again 🙂
thanks, well explained to a beginner like me. appreciate how a complex method was easily explained using a basic whiteboard and a relatable example.
i reeeeally liked the pen flip at 3:27!! keep up the great work!
Thank you so much!
Ritvik, once again you do an amazing job simplifying concepts in short periods of time, while still making them very understandable. Thanks!!
Concise and right to the point, as always. Thank you!
Thanks for the video! This is definitely the best explaination of Random Forest I have seen yet. I'm really enjoying learning Data Science from you
Awesome, thank you!
Very well organized and well put together. Simplified enough for the medium, but included just the right amount of detail to guide one in their further pursuits of the topic. Thank you.
Ritvik, hey, thank you... this was really, really helpful - a great explanation, Jarrell
Glad it was helpful!
This is THE BEST explanation of Random forest!! Thank you Ritvik :)
all hail the marker juggler and his short, crisp, easy to understand videos! Keep it up dude.
this is some high quality content. you deserve more views! great teacher.
This was an amazing video and super well made. It's astonishing how this material is free to learn from!
I'm trying to learn some ML content as it relates to classification to quite a large degree, and just want to say that this video on Random Forest is one of the only ones that actually made sense to me as a layman! Thank you
Wow! You are really good at explaining stuff! That was amazing!
Glad you think so!
Wow great explanation - I am hooked on these videos. Get the main points in a short timeframe - would be nice to have a video on Tuning RF and other ML algorithms. And the pre-req videos are very useful to have the right background to understand this one.
Thank you!
Great lecture, help me recall random forest when I am learning the causal forest
This is an amazing class. It contains all the important parts of random forests.
He’s simply the best!! Thanks for all your effort
Loved the interpretability of the random forests idea! Very clever / useful. I'm guessing that you would want to reshuffle the dth feature for each i to avoid the effect that the shuffled data accidentally correlates with an important feature.
Amazing video... You can also cover parts like random projections... That's something which can make them much more interesting.
That's a great idea!
First time I see this way of computing feature importance, thanks!
Fabulously concise and accurate!!!
My favorate and best teacher in CZcams !
Just found your channel. Really well explained. Thanks :)
what an awesome video! congrats, really helpful
I can't describe how good your explanation is !!!
thanks!
This is the best explanation I’ve found, thank you 🙏
Glad it was helpful!
You are godly easy to follow, big thank you from my heart
Glad I could help!
This is gold.. pure gold!!
Thank you ritvik!! This video is so helpful!!
Big Thanks for a clear explanation!!!
Fantastic presentation!
The algorithm described is random sampling, not bagging. Not bootstrap samples are being created as described.
amazing video!! really helpful, thanks!!!
Glad it was helpful!
Ritvikmath, i would like to complement you with the clear direct explanation video's. you make it easily accessable and clear with practical examples. please keep it up.
Kind regards,
Jan Pieter Wagenaar
You are most welcome!
This is great! How about a point or two about the pitfalls of using random forest for time series
Thanks for the great video! Do you have a video or any recommend for RandomForest on Regression math derivation? Thank you!
Using associative rule mining and extracting all the rules from all decision trees we can interpret random forests.
great explanation much easier to understand
excellent vid! thank you.
Thanks Professor , your explanation is very good. I am really enjoying your videos and they are helping me to focus on DS. I have seen many videos prior they only mention Idea 1 - Bagging and say it is Random Forests. But you have mentioned Idea 2 - Random Subspaces as well. Just to confirm on it , do the Random Forests use both the ideas ? Do you mean that Bagging + Random Subspaces = Random Forest ? If possible can you explain how to code it ? Thanks for your time on videos ! Many of your videos are good , even your Bias-Variance video is also super.
what a great explanation, thanks man :)
You're welcome!
I love it!
Best DS CZcamsr
Awesome explanation thank you
You are aweomse!
Thanks for the video. can you also explain interpretability via LIME and Shapely values?
Great suggestion!
This is it. Thank you so much .
Thank you!
Great!
Yo I heard the RF is bad alone and needs help when: 1) a strongly predictive linear feature exists in X. You gotta help the RF out by either feeding it the residuals from running the linear model on that feature first, so each model in the ensemble can do what it does best, the linear doing linear things and the nonlinear RF doing nonlinear things. Or else just preprocess to create an additional feature which is just the output of the linear model, and give the whole augmented feature set to the RF now. 2) 2nd order associations are expected to be important, because despite its subsampling of feature space, the RF is actually NOT good at automatically finding 2nd order predictive associations in X. THus we should help the RF out by doing some feature engineering of the 2nd order terms in advance into the X and then give it to the RF NOW. Further it might help still more by telling RF to stop using the typical 0.5 ratio default of subspace sampling and instead just focus on exactly 2 columns at a time, no more, no less, forcing it to look much closer at all the 2nd order associations that you expect should be found by the RF.
These are hear-say and hypotheses. It would be cool to see how to do it in sklearn's pipeline on a dataset like "jewellery" which is used for demo code by the pycaret library. Jewellery has a strongly predictive feature "carets" or "weight" in its X. But they just look at trees alone in their model search, so I think it can be improved by helping out the fancy nonlinear tree models as described above.
Why do we need the accuracy value on the 20% for each tree? Does that help with some weighted average?
you are a legend
great video
THX!
Great video. But why permute on the training data and not on the test data? This should also show the importance of the feature, right?
I think that it's since we're trying to focus specifically on the importance of each feature to the model. We're avoiding adding the additional variable of how well the model generalizes and therefore works on the test data so we can see the features' contribution to the model's accuracy under ideal conditions.
Love your videos, very helpful and well explained
Happy to hear that!
u r incredibly amazing ,but i have 2 questions :
1- What is the meaning of when i use all features the tree will be correlated to each other, i know what is the meaning of 2 features are correlated ,but what is mean when i say 2 trees are correlated ?????
2- when i need to determine how much a specific feature is important now , i trained the model using 80% of the dataset and now do i get the accuracy of this (80% dataset) of the dataset and after that shuffle my specific column and get the accuracy again of 80% of the data after shuffling then subtract them ? or i'm using 20% for both ? but u said in the video u r get the accuracy of the data that made that tree so u almost talking about the 80% , it make no sense for me using 20% of the dataset
your're the goat
impressive, thanks
Glad you liked it!
Can't we get the feature importance for free, without permuting, by looking at the accuracies of models trained with and without certain features (in the random subspace step)?
you are goated
kkkk i like the entrance style
I love you.
Oh my deus thank you
🍺
🍻
Thank you!
You're welcome!