Exploratory Data Analysis with Pandas Python
Vložit
- čas přidán 15. 05. 2024
- In this video about exploratory data analysis with pandas and python, Kaggle grandmaster Rob Mulla will teach you the basics of how to explore data using python and pandas. Exploratory Data Analysis it a necessary tool for any data scientist. Pandas is a MUST for anyone getting into data science with python. Python is the #1 coding language for data science and has been growing over the years as an essential tool, with Pandas being the main data wrangling module. Kaggle Grandmaster Rob goes over it all in this video. In this video we discuss the basics of how to use explore data including...
Timestamps:
00:00 Introduction
01:00 Imports and reading data
03:35 Data Understanding
06:40 Data Preparation
20:57 Feature Understanding
27:35 Feature Relationships
35:30 Asking a Question about the Data
40:00 Final Thoughts
Follow me on twitch for live coding streams: / medallionstallion_
Intro to Pandas video: • A Gentle Introduction ...
Link to kaggle notebook used in the tutorial: www.kaggle.com/robikscube/int...
* CZcams: / @robmulla
* Twitch: / medallionstallion_
* Twitter: / medalliondata
* Kaggle: www.kaggle.com/robikscube
#Python #Coding #DataScience #Kaggle
Chapters don't appear to be working for my videos for some reason. Here are the timestamps for the video:
00:00 Introduction
01:00 Imports and reading data
03:35 Data Understanding
06:40 Data Preparation
20:57 Feature Understanding
27:35 Feature Relationships
35:30 Asking a Question about the Data
40:00 Final Thoughts
amazing video, please can you make available the dataset used? thank you
Hi Rob. I'm new to notebooks. Could you plese explain why you don't need an explicit print statement to view cell output?
This was one of the bad video and non industry knowledge
😮
As a begginer in data this really opend my eyes as to how things works. Your explanations are very clear and I can feel how passionate you are. Great video
Glad it was helpful! I am passionate about it, and excited when I hear people are learning from my videos.
So true,, though there are many projects and training videos outside. The way you think, step by step approach and the reason for doing so, is so relatable and feels very natural. Awesome video, Thank you so much
There are a ton of EDA videos on CZcams. This is one of the best I have ever come across. You just nailed it, Rob.
Thanks so much!
This is a great refresher guide! Very nice coding style and I appreciate you using a simple Kaggle dataset to follow along. Great stuff - thanks!
Great channel! Very helpful for beginners and for those who' re digging deeper and moving forward into DS industry as myself! Thanks Rob!
Hi Rob, this was super useful to me as a tired Excel veteran and python beginner. You explain and demonstrate everything so clearly, thank you
I have tried plenty of tutorials by now. This is the most precise and to-the-point tutorial so far. Well done.
Great video: informative and fun; easy to follow along. Helped me feel motivated to tackle more Python Pandas. Thanks so much!
This is one of the best content related to Data Analysis and Python/Pandas, I am really glad I found it! Thanks!
Thank you for sharing this, Rob! This is wonderful content. Keep up the good work.
Cheers!
this is absolutely amazing! Follow your video step by step actually make me more confident of my coding!
I can’t get enough of your videos, especially the very hands-on practical approach to learning. Your explanations are clear and easy to follow along with. Please make more of these types of videos. You are definitely makes a change and contributing to the CZcams knowledge pool. Thank you so much.
This is such an amazing guide! I’m new to data analysis and had limited python exposure and have taught myself most of these things so far by googling or just reading the pandas documentation. Watching someone familiar with the process do it all together was really helpful and gave me a lot of insights as to how I can improve my skills and workflow. Thank you so so much!
Hands down one of the best tutorial I ever saw. Basic enough to follow as a newbie but demanding enough to be useful. ❤
Thanks a lot, you explain concepts like no one, subscribed!
This video makes me feel glad to be alive. Great explanation, amazingly fast and on point. Thank you!
Lucidly explained. One thing i have learned that in order to be a great Data scientist what matters is your problem solving skills, understanding the business requirements and curiosity to dive deep into data (true to the name data scientist) . There is no need in remembering these codes as long as you know what to look for.
It was fantastic. Every step you took was kind of amazing, specially the last bit where you visualized average coaster speed by location. Thanks.
thank you so much, you have made my EDA analysis easier and faster. :) also, it's easy to digest as I go along with the data you are working. thanks a lot. you are helping a lot of analysts or people who wants to study in data analytics. Great video, keep them coming.
Wow ! this is such a clean run through. You make it look so easy and easy to learn ! Thank you so much. This is giving me the confidence to finally start something on my own.
Thank you for the video. You have combined all my knowledge into one comprehensible picture.
This is perfect for my interview tomorrow. I just needed a refresher on how to approach the problem, ask right questions and then come up with exploratory options.
Thank You so much for this video
Really loved seeing the pairplot. Will definitely try this out this week
I have watched more than 5 times its really eye opener and step by step teaching. Well done Boss
Great stuff man, thanks so much for this. Youre great at teaching beginners!!!!
Great video. Clear explanation! You just earned a new subscriber
Definitely amazing. Thank you so much, Rob!
Great! Thanks a lot for this tuorial, so helpful for me as a beginner!
wow... thank you so much rob. I come from a frontend background but just began a data analytics bachelor at SJSU. I was trying to grasp at a high level what DA might look like as it pertains to conducting an explorative project. This tutorial completely cleared up those questions!
Thank you! that was very informative!
Clear and applicable to any type of analysis. Thank you
Thanks Rob, you’re doing a great job for the data science community.
Your videos here and on TikTok is helping me a lot in this journey.
Thank you.
Love to hear that Wahab! Glad you learned something, and thanks for posting the feedback.
The quality of your content is only surpassed by the ease at which it is to assimilate it, keep up the great content Rob, cheers!
Wow. Thanks for the positive feedback!
@@robmulla bi
L😅
🎉😊
Very well explained and quite nice difficulty level! Brilliant!
I dabbled in this 4 years ago at EDX. This is a wonderful refresher. Thanks Rob!
By far one of the most clear and concise ways of teaching in a computer science related field I've come across in a while. I'll be binging all your tutorials for sure!
Whoa. I love this feedback. I'll try my best to keep them coming.
You are the best coach. Thank you, sir!
Thank you so much. I appreciate the work you put into your videos. It shows.
I really appreciate the feedback! Please share with anyone you think might also learn from it.
Amazing, Thank you so much, the best tutorial!! :)
@Rob Mulla: Excellent video on EDA
Awesome! Love the method chaining
This is the best reference guide. I always find myself rewatching this whenever I'm cleaning a dataset.
So glad you find it helpful.
This is GOLD! Thank you
Hey Rob, really admired the way you explained complicated topics with ease!!
Looking forward to learning from you more :)
Thanks so much for that feedback. I really apprecaite it.
Great stuff - thank you, Rob!
Thanks for this lesson. It’s much valuable.
This is a brilliant video, helped alot thankyou!!
Really cool and looks so easy now, thank you Rob
Pair-plot looked absolutely beautiful!
Perfect stuff what I love about this video is the simplicity and the clearness of the way you talk
I appreciate that! Thats how I learn best so it's also how I try to explain things.
@@robmulla your response reflect your both knowldge and wisdom please keep on 💞
Just completed it along with coding it all!
Thank you Rob for your explanation, before this it was hard for me to study and my mind just start pressured me of how to do EDA with Python language. And this video just open my mind to study it!
Awesome video! Thanks for putting the time into this. Very helpful
Glad it was helpful! Share with a friend!
@@robmulla I certainly will. Thanks
This is a really good tutorial. I am new to Python and data analysis, and was completely lost. It was so hard to find a good, reliable source about it. This source just clarifies the basics for beginners so that I can start off with my own project.
Great video. Look forward to your twitch streams!!
Thanks so much. Hope to see you during one of the twitch streams soon.
This video is.... PERFECT!
Thanks ^^
well organized, concise, very helpful to get grounded in Pandas. my explorations will continue. Thanks!
Glad it helped! Thanks for watching. Share with anyone else you think might also learn from it.
Clear explanation for beginners.. will follow you more for tutorials
This was a really nice tutorial, Rob. Had fun coding along, thanks for doing it :)
Thanks for watching and providing feedback. Feel free to share with anyone else you think might also learn from it.
Excellent work and introduction. Very well done!
- import data
Data understanding
- filter columns by need
- convert dtype of certain columns
- rename columns
- check isna in columns and dropna on row or column accordingly
- locate duplicated rows in single or multiple columns
- drop duplicated rows from dataset and reset index
Data prep
-univariate analysis of features - kde, histogram, box plot
- use value counts to determine duplicates and unique values in feature
- he creates bar plot for top 10 years introduced to highest # of coasters
- he creates histogram to bin speeds of roller coaster and view their frequency distribution
Feature understanding - scatterplot, pairplot, correlation, groupby
- he creates scatterplot for speed and height with year based hue of points
- he create pairplot to compare correlation between features, alongside hue from material type
- creates a correlation heatmap for selected features
Ask question
- he uses groupby and query to create bar plot with sorted descending data on mean speed of roller coasters by location.
Your explanation is easy to understand and also show how the things work, ThankYou
please make more videos about EDA in python Rob!!
It has been great to refresh some topics and learn new ones. Thanks a lot :)
Thanks Pedro. So glad you’ve found these as a good refresher.
This is the second one of these I have now watched and coded along with! Genuinely awesome content, so precise and simple to follow. You make daunting tasks (for beginners getting into data) really accessible which is a sign of a great teacher!
Comments like this make me really happy that I made this video. So happy it helped you in your coding journey. Did you use the Kaggle notebook when you followed along?
you are the best teacher ever, I'm not good at English but I try to write down this sentence to show my appreciate to you. Im still waiting for new lesson using pandas for Data Analyst
Thank you very much Rob for this wonderful walkthrough and explanation! Really Appreciate it!!!!
Thanks for the feedback! Glad to hear you learned something from it.
Terrific introductory survey that answered so many of my questions, moving from SQL. Looks extremely efficient. Now, to plug into my data! Thanks.
Glad you liked it. Sql still has a place but when working with the data for EDA pandas can’t be beat.
This is very helpful. Thank you, Rob!
Excellent explanation Rob. Learned a lot from this video. Keep it up.
Thank you so much. I am happy for your teaching about EDA with data analysis for pandas. I am clearly explaining to you. I can continue my hands-on experience for EDA
#1 Data science youtuber!!!
You made easy to understand the basic commands e sintaxes.
Thank you a lot, Rob. 😉
Tell all your friends. 😆
Agreed, this is the best Python content on the entire internet, hands down. I'm going to be carefully watching these videos over and over for a long time.
Great Job Rob. I got vast knowledge about pandas from this video
I have been grinding through your videos lately in preperation for my data science job and you have been an absolute blessing! Thanks a bunch!!
Wonderful! Glad I could help.
Hey Adarsh! Other than this what else are you learning that will help you in the data science job, I'm also preparing for the same but kinda new to data science so any guidance would be appreciated. Cheers!
@@hmx21 Hi Hemang. I'm a fresher in data science as well. I started with Python and statistics. Then moved on to EDA followed by Machine Learning algorithms. I then made a few projects on ML. Also tools like SQL, Power BI, Excel are preferred
@@adarshtiwari7395 Hey Adarsh! Thnaks for the reply, I'm done with EDA and made a dashboard using Power BI, and don't know how much machine learning or SQL is required for the role as I've studied SQL in college and know how to work with joins,etc. Any tips or resources you'd like to share would be a great help. Also from where did you learn stats for ds, whenver I try to learn stats online I get overwhelmed with the magnitude of tutorials.
@@hmx21 depends on what you're going for. If you are interested in a data analyst position, EDA through Power BI is great but if you want to go done the data scientist or machine learning route you need to be hands on with Python. EDA using python is much more nuanced as compared to visualisation tools like Power BI. SQL is essential in all contexts so it's a must. But whether you should study machine learning depends on your career goal.
Very nice explanations , thank you so much!
this is a wonderful video!
This type of videos are amazing to follow, i am starting to use python for data analysis and i could not happier! Your channel is helping me alot, thank you!
So happy to hear this. Let me know what you would like to see in future videos.
@@robmulla One question i have is about the safety of using jupyter while working with company data.
I am just starting to use jupyter and that is a big question that i'm sure other begginers would like to know to! Can you give your opinion on it? Thanks in advance
I'm impressed! your videos are excellent. Thanks, Rob
You know how much I would have loved to have known this in my last project at work. Dealing with access data from the 90s suck.
Thank you for the tutorial, Rob!
Thanks for watching and commenting. Share it around if you want to.
Excellent tutorial and immediately useful. Thank you!
Glad it was helpful! Thanks for watching Zhao.
I completed my certification in data science but could not figure out where to start. Thanks for such a detailed and easy to understand instructions with very useful commands. It helps a lot. Keep it up
I was smiling at 39:23 . How easily you answered the question. Thanks for this amazing video tutorial.
My pleasure 😊 Glad you liked seeing it all come together at the end.
This was the greatest Tutorial I ever had. Thank you. Here I get to cnow about the corelation and some panda functions and ploting.
But for Power counting and Corelation between Variables was very pleasend and satisfied my expectations. From Bulgaria Volga Sauvete! Thaank you !
👑👑👑👑👑👑
Very crisp and concise explanation. Sometimes youtube videos can be better than paid courses.
Wow so many things are covered, its a great tutorial for getting started with EDA.
Thanks @somuSan. Glad you liked the tutorial. It took me waaaaay longer to film than I expected but I'm happy with the result. I hope more people in the future find it helpful.
Thank you!!! I learned a lot from your course.
Glad you found it helpful!!
your content is pure gold! thank you
Glad you enjoy it! This comment is gold. 😎
amazing video, appreciate it a lot!
Wow, what an informative fun tutorial. Thanks Rob!
Glad you learned from it and I appreciate the comment.
An absolute legend, thank you
This is a great video. So helpful and informative. Thank you.
Glad it was helpful! Thanks for watching and tell your friends!
This is the best video I have watched so far. Thanksss!
Thanks so much!
Some of your other videos I found too fast paced, like about pandas mistakes, this one here has great content and also fantastic presentation. Thank you.
Thanks for the feedback. I’ve been experimenting with different editing styles so it’s nice to hear you prefer slower paced like this video. I’ll keep that in mind in the future.
very useful tutorial video, 😍 this makes me less scared of learning Python than before
thank you for your great work !!
Late to the party but this is really really good. Helps you dig in to the detail (rather than you thinking, how do I do what I'm thinking I need to do). This should be a template to use as it general enough for you to pick it up but specific enough with examples to be used elsewhere
Excellent and succint. THANKS!
Glad it was helpful! If you can, share it somewhere you think others might also learn from it too!
excelent job i learned a lot from this video thnk you
Really great video. Clear and well presented. Thank you.
Glad you enjoyed it!
I almost never comment, but I had to with this one. the video was amazing. I'll be checking more of your videos.
Excellent video Rob, thank you!
Thanks for watching!