Pandas functions: merge vs. join vs. concat

Pandas is very useful but sometimes it could be hard to understand the differences between some functions that work towards similar goals. In this video, let's see how merge, join and concat works and what their differences are.
RESOURCES:
🏃‍♀️ Data Science Kick-starter mini-course: www.misraturp.com/courses/dat...
🐼 Pandas cheat sheet: misraturp.gumroad.com/l/pandascs
📥 Streamlit template: misraturp.gumroad.com/l/stemp
📝 NNs hyperparameters cheat sheet: www.misraturp.com/nn-hyperpar...
📙 Fundamentals of Deep Learning in 25 pages: misraturp.gumroad.com/l/fdl
COURSES:
👩‍💻 Hands-on Data Science: Complete your first portfolio project: www.misraturp.com/hods
🌎 Website - misraturp.com/
🐥 Twitter - / misraturp

[@misraturp]

Which Pandas functions would you like me to compare/explain next?

[@YogiNotTheBear007]

hi, could you please explain cut, apply and map?

[@misraturp]

@@YogiNotTheBear007 Added to the list! Thank you!

[@arshad1781]

Make a complete video series A to Z step by step on Data science, Machine learning, Deep learning like hot 🔥 topic

[@misraturp]

@@arshad1781 Good idea, thanks Arshad!

[@zulhishamtan4308]

Merge_asof() is awesome for time series merging. Hope you can consider to make a video for it. Thanks again.

[@mosama22]

Do you know what I really LOVE about your videos, you COVER THE WHOLE TOPIC, so if we talking about reshaping for example you mentioned all the 8 functions could be used and then you chose. Having the full picture really helps a lot. Even if you are an expert, going back to your videos, sometimes help remind us what other options do we have, or what other functions we might forget about.

[@mosama22]

Thank you for the beautiful videos, I'd just appreciate if you added a link to the data set and the notebook you use for each video please, so we can follow up with you.
Thanks a million again for the beautiful videos 🙂

[@bethuelthipe-moukangwe7786]

The lessons about pandas are now making sense to me, especially on how to use groupby, apply ,apply map and lambda function.
Big thanks Ms Misra Turp.

[@Xirato95]

Thank you for your clear explanations! I love it how you explain it while using a simple example and go through it step by step. I’m new to Python and Pandas library and while looking up different functions the explanations can be a little bit overwhelming. You made this noobie prove! Keep up the good work and much appreciated!

[@misraturp]

This is awesome to hear, you're welcome!

[@oscar-expertprojectmanager6733]

Thank you Misra. Great explanation on the Pandas functions: merge vs. join vs. concat. One comment I would make about using pd.set_options('display.max_rows', None) and pd.set_options('display.max_columns', None); If your dataset is large, you run the risk of crushing your notebook, and you would have to go through a process to fix it.

[@gaganbhattacharya9890]

I didn't know what does ''left_on & right_on' means in merge & the difference between merge & join but now I understand!
Thanks!

[@SESHUNITR]

loved it Misra. clear explanation and a quick reference if we forget.

[@misraturp]

Great to hear!

[@kentjordan4658]

May you provide the dataset? Thanks! 😄

[@blackpenny9628]

great...concise and straight

[@ahmedalhomeidy]

clear explanation and precise and on to the point, I love it

[@misraturp]

Thank you!

[@zulhishamtan4308]

Thank you for the sharing... Awesome... I learnt a lot...

[@mariaclaraceballos3488]

thanks for the explanation! what happens if we use the function concat with 2 dataframes that have repeated data, i mean an ID that is in both dataframes?

[@harishpoalampalli9637]

Hey Turp !! great explanantion !! Is it possibe to provide the data sets !! Thanks

[@ArunKumar-sc9dl]

Thank you, very simple explanation.

[@misraturp]

You're welcome!

[@86Maryj]

Hi can you please help to do pivot with multiple sheets

[@khemrajpatil5683]

Thanks for the vide!. It gives me clarity.

[@misraturp]

You're welcome!

[@loordgo8772]

thanx for the video. what about Merge Conflict? can be detected using Pandas?

[@ashwinr1407]

clear and informative ! thanks.

[@misraturp]

You're very welcome

[@nicknicknick7860]

Nailed the explanation, thank youu!

[@misraturp]

You're welcome :)

[@kennethstephani692]

Great video!!

[@misraturp]

Thanks!

[@domillima]

When you merge left_on='ID', right_on='ID2'.. two columns of different names with the same IDs, is there a way to drop one of these, other than adding .dop(col_name) at the end? thanks

[@ishanseth4442]

Thanks a lot

[@AmitMishra-xd7yo]

Thanks! It's pretty useful!

[@misraturp]

Great to hear!

[@avirajankitjain256]

Hi , where is the data set?

[@ahamedsuhails]

Thank you

[@vaibhavk2430]

In streamlit can you implement direction feature like we have in google maps i.e. we choose our starting point and ending point and and there is a direction showing the way

[@misraturp]

I don't think so but then again I never tried doing that.

[@batyratayev2230]

Thanks @misraturp!

[@anurajms]

thank you

[@abinetayele7901]

Perfect video.

[@misraturp]

Glad you think so!

[@GregThatcher]

Thanks!

[@misraturp]

Thank you!

[@tusharwarade4603]

plz add datasets used in this video😊😊

[@bryan-9742]

I never got sent any of the cheat sheets. Are you sure that links is still functioning?

[@misraturp]

Hey Bryan, it should still be working. Could you check your spam folder. I see that someone with the name Bryan submitted the form but never confirmed their email. (Don't want to share the last name here but that could be you). Either way, if you cannot find the mail in your spam folder, you can get it here too: misraturp.gumroad.com/l/pandascs

[@vijhey3850]

wheres video for group by ()?

[@misraturp]

Good idea!

[@arshad1781]

Nice 👍

[@misraturp]

Thanks!

[@busrauygun1158]

Videolarınıza Türkçe altyazı ekleseniz Türkler de bu nimetten faydalansa çok güzel olmaz mı

[@sanooosai]

rocker

[@chethanhv3125]

thanks @misra Turp

[@misraturp]

You're very welcome!

[@vigneshm4916]

Great video !

[@misraturp]

Thank you!