How Data Science ACTUALLY Works

SdĂ­let
VloĆŸit
  • čas pƙidĂĄn 26. 07. 2024
  • Check out Deepnote for the easiest way to practice your data science skills: deepnote.com/?...
    Dataset used in this video: www.kaggle.com/datasets/thede...
    Ever wanted to know how a real Data Science team operates? Join me, me, and me, as we take you through a rushed Data Science ask from management. Can we get the work in on time?
    00:00 - Introduction
    00:14 - Management Call
    00:56 - Team Overview
    09:38 - Data Engineer Work
    14:11 - Data Scientist Work
    20:58 - Data Analyst Work
    My FREE Courses:
    🐍 Python 🐍. : ‱ Python for Data Analys...
    ⌭ SQL ⌭ : ‱ SQL for Data Analysts ...
    📊 Tableau📊 : ‱ Tableau Beginner Cours...
    📈 Statistics 📈 : ‱ Practical Statistics f...
    đŸ€– Machine Learning đŸ€– : ‱ Machine Learning for B...
    Patreon: / shashankkalanithi
    MX Master 3 amzn.to/3sTroBW
    LG 35in Curved Monitor: amzn.to/39pPzR3
    USB-C Hub: amzn.to/31Ip8Sl
    MacBook Pro Retina 16 Inch: amzn.to/2PSwZde
    Twitter: / kalamari95
    LinkedIn: / shashankkalanithi
    Sponsored by Deepnote

Komentáƙe • 141

  • @jameswhitaker4357
    @jameswhitaker4357 Pƙed 2 měsĂ­ci +2

    As a data analyst, all I do is CODE. But I love it! Interesting to see how my job functions align more with your description of Data Engineer.

  • @fenrir433
    @fenrir433 Pƙed rokem +57

    This narrative scenario/example was amazingly put together and would love to see more of this type of content! Even unique scenarios or complex projects that a DS/DE/DA team may typically or rarely encounter.

    • @ubaldo7227
      @ubaldo7227 Pƙed rokem

      Motion seconded. Thank you very much

  • @lifejourney1661
    @lifejourney1661 Pƙed rokem +17

    This video is just amazing! Not only does it explain the different roles very well but this is the first time where I can directly see the flow of work and the details in practice. Very valuable! I also found out that I am more of a data scientist haha. But I also see that the roles often overlap at least during my PhD in Political Science as I need to find the raw data, merge them, structure, use regression and illustrate the results. It is nice that people can focus on their niche in companies though

  • @yacoubahmedsidi6168
    @yacoubahmedsidi6168 Pƙed rokem +1

    Man you the best! As someone who’s interested and studying data analytics, I needed such video to see the bigger picture and to know how the rest of the team works.

  • @dard4642
    @dard4642 Pƙed rokem +2

    I'm finishing my MSDS in June and this is very helpful. In all of my projects, I am every role from gathering to presenting and it is good to see the real-world demarcations of duties. Thanks!

  • @hazema.6150
    @hazema.6150 Pƙed rokem +2

    Great video and I love that you didn't cut googling stuff and debugging.

  • @Pakman909
    @Pakman909 Pƙed rokem +11

    Love this teaching format. Would like to see more of these. Great job!!!

  • @latoyabrown9107
    @latoyabrown9107 Pƙed rokem

    I love this. I took a course on how data teams collaborate, but this video connected all the dots. Thank you!

  • @fakhruddinmasalawala9525
    @fakhruddinmasalawala9525 Pƙed rokem +5

    Thank you for such a refined video explaining every role in a data team.
    Truly eye opening.

  • @paulbuono5088
    @paulbuono5088 Pƙed rokem +1

    I just watched one of your earlier videos from a year ago and now this one and I must say you have improved so much on your speaking and presentation skills. I need advanced math to count how many times you used to say "um." Now your videos are much smoother and your presentation is a lot more logical and concise. Bravo!

  • @hanzoshimada4526
    @hanzoshimada4526 Pƙed rokem +3

    This certainly gave more clarity of the different roles. Awesome content as always!

  • @j192002
    @j192002 Pƙed rokem

    This was amazing to watch. As one of your students, this was great! New job has me working crazy hours, been hard to attend live sessions.

  • @sabzuski
    @sabzuski Pƙed rokem +14

    Man I think this was excellent! For people in school with no real world experience yet, this is so informative! Thank you so so much! Well done!
    I think a cool video you could do in the future would be one focused on setting up the S3 and/or DeepNote in more detail.

  • @samirraki3863
    @samirraki3863 Pƙed rokem

    This has been of a great help to wrap my head around how data science works!! Thank you so much

  • @alainj1
    @alainj1 Pƙed rokem

    This is a cool vid on a how a daily team should run. Pretty informative I must say, another video with great info!

  • @roheldham568
    @roheldham568 Pƙed rokem

    These videos are incredibly helpful! I remember you had made a similar style video for analyzing game review data. Please make more of the same!

  • @vamanhameed1402
    @vamanhameed1402 Pƙed rokem

    Awesome video, from the beginning up until the last part, all of it was very easy to understand, clear and put together in a wonderful way. I'm happy that I found this video.

  • @markslima1557
    @markslima1557 Pƙed rokem +1

    This really ties the thread into process, so very helpful. I'm wondering about how far I need to take my SQL and Pandas, this cleared up a lot of ambiguity for me.

  • @mohamedabdo-xg6tw
    @mohamedabdo-xg6tw Pƙed rokem +1

    I am a data Analyst, never used DeepNote. I will start using it from tomorrow. Thank you for the great content

  • @pepperpeterpiperpickled9805

    Mate, you answer questions I didnt even know I had. Top quality.

  • @Eldo_thomasbaby
    @Eldo_thomasbaby Pƙed rokem

    Many people upload tutorial videos. You are the only one who makes video with a good real world example. That helps me a lot. And also you share the file. That also helps a lot

  • @maryalvin1357
    @maryalvin1357 Pƙed rokem

    This makes so much sense! Amazing!
    Really appreciate your channel!

  • @justind7029
    @justind7029 Pƙed rokem +2

    Awesome explanation of the entire process. Love the format.

  • @phostings
    @phostings Pƙed rokem

    You are absolutly right about the environment set up. I have the M1 chip and others have intel. Everyone with a M1 chip had so many issue, including myself. However, I was able to get the environment set up after a few days. Now I'm working with Rstudio and using Rshiny to generate my plots into an interactive webpage. This field is so awesome, but it has a lot of headaches even just getting started. I guess this makes me the Data Engineer,lol.

  • @JoseAguilar-yz4bq
    @JoseAguilar-yz4bq Pƙed rokem

    Such a good video, you took the fear from me of not knowing how and who to ask for things when I get a data job.

  • @ashwinponnappan9721
    @ashwinponnappan9721 Pƙed rokem

    Really helped in clearing things out! Thank you for this wonderful session

  • @changshenglee8333
    @changshenglee8333 Pƙed rokem

    very clear overview for each roles' duty. good content! thanks

  • @zarathustrasmonky
    @zarathustrasmonky Pƙed rokem +18

    Excellent video. Love the narrative format. I’m a research coordinator at Emory and I’m transitioning to data analysis then data science. Your CZcams channel has been invaluable. Thanks

    • @Mukawakadoodoo
      @Mukawakadoodoo Pƙed rokem +1

      I’m an optician and am planning to career shift into data science as well, any pointers dude?

    • @zarathustrasmonky
      @zarathustrasmonky Pƙed rokem +1

      @@Mukawakadoodoo Not really. Just be persistent and consistent in applying high quality instruction

    • @ionwhy2561
      @ionwhy2561 Pƙed rokem

      Look like someone has been reading fredrich neichece’

    • @sereysothe.a
      @sereysothe.a Pƙed rokem

      aye I go to emory too!! applied math and stats major

  • @rishavjain1867
    @rishavjain1867 Pƙed rokem +1

    This is a brilliant video to give brief insight on how data professionals actually work togetehr

  • @mohitupadhayay1439
    @mohitupadhayay1439 Pƙed rokem

    Would like to see more such videos with different issues coming up at different roles and how they interact.

  • @safifaruqi
    @safifaruqi Pƙed rokem +5

    I am a BI Developer, and wear all three hats in my mid-size organization, this is actually really accurate, and I highly recommend coding in python and SQL for DA/BA guys,

  • @lumiAI
    @lumiAI Pƙed rokem

    this is insanely good, thank you for sharing this!

  • @leonidgrishenkov4183
    @leonidgrishenkov4183 Pƙed rokem

    Omg, this so cool. Amazing work! :)

  • @colinb8332
    @colinb8332 Pƙed rokem

    Awesome video. I work in SE with a cloud focus. Have an economics degree so have thought about moving into either DE or DS.

  • @uriastriumph4780
    @uriastriumph4780 Pƙed rokem

    Your videos and the brilliance behind them >>>
    I appreciate you. đŸ™đŸŸ

  • @gorkemyilmaz4861
    @gorkemyilmaz4861 Pƙed rokem

    Amazing content, great explanation with simple scenario! Keep it up man!

  • @brownboi9267
    @brownboi9267 Pƙed rokem

    I should work more on SQL and BI tools specially communications . Thanks Shashank !
    I started watching your videos when you had like 1k subs, love to see you grow into a big channel !
    Good Luck, Cheers!

  • @livenalive
    @livenalive Pƙed rokem

    Thank you brother, we truly appreciate your efforts. You keep motivating and helping the rest of us!

  • @Headlikeanorange84
    @Headlikeanorange84 Pƙed rokem

    This really is illuminating. Thanks so much for your amazing content!

  • @Pradee1995
    @Pradee1995 Pƙed rokem +1

    Great initiative!!

  • @Flylikea
    @Flylikea Pƙed 9 měsĂ­ci

    Thanks, a very accurate description and definitions.

  • @Mohammad-tw7cq
    @Mohammad-tw7cq Pƙed rokem +5

    Great video! I enjoy these kinds of videos that show the interplay between data analysts, engineers, and scientists. Also, that NASA jacket is đŸ”„

    • @ShashankData
      @ShashankData  Pƙed rokem

      Thank you! Yeah I really enjoy it :)

    • @markslima1557
      @markslima1557 Pƙed rokem

      @@ShashankData sir, where did you get that jacket? it is pretty snappy!

  • @EzeChiappero
    @EzeChiappero Pƙed rokem

    Great content!! Super useful and clear!!

  • @shalimarlittle8374
    @shalimarlittle8374 Pƙed rokem

    SO helpful. Thank you!

  • @santiagojulianlingeri5386

    Best video ever! Very insightful for a learning DA đŸ™‹đŸ»â€â™‚ïž

  • @troy_neilson
    @troy_neilson Pƙed rokem

    Great video and a fantastic breakdown of the industry.

  • @benjamin4206
    @benjamin4206 Pƙed rokem

    Beautiful! Thank you!

  • @dadimontv8414
    @dadimontv8414 Pƙed rokem

    Amazing video. Thank you.

  • @nibycolisp974
    @nibycolisp974 Pƙed rokem

    Another great video Shashank. Thank you so much for the great content. Your videos have really helped clear up so much about the analytics industry for me. I have a meeting with my manager in an hour to present my first project to them - a simple reporting tool that automates their reporting process (instead of them going through 500 rows of data a month manually!). I'll be asking them if it’s possible to take me on as a Junior Analyst, as the team/service currently does not consist of any analyst/data professionals. Wish me luck!

    • @ShashankData
      @ShashankData  Pƙed rokem +1

      That’s amazing best of luck u got this :)!

  • @datascienceproject
    @datascienceproject Pƙed rokem

    Amazing video! Thank you :)

  • @abhijitprasad4740
    @abhijitprasad4740 Pƙed rokem

    Love the way you explain the concept

  • @brandone487
    @brandone487 Pƙed rokem

    Thanks for such great information. If possible, can you provide an overview of business intelligence/analyst roles and how they relate to the data team in a company.

  • @gamelikofijerome5829
    @gamelikofijerome5829 Pƙed rokem

    Amazing content with great clarity 👍

  • @HoneyBadger-101
    @HoneyBadger-101 Pƙed rokem

    thanks to share this worthy information 😊

  • @matattz
    @matattz Pƙed rokem +1

    Oh wow that’s great content!! So basically as a data scientist you don’t have to know everything from coding to data visualization like Tableau. But let me guess in some companies you also have to do the work of a Data Analyst so knowing these type of things are really helpful if needed but aren’t necessary at the beginning of a career

    • @pedrobaaijens4132
      @pedrobaaijens4132 Pƙed rokem

      In some companies where stuff like this is new they hire maybe 1/2 people, sometimes consultants to set things up and if there are already requests of data driven decisionmaking then you gotta do the whole process alone.. I had to do the engineering, science and visualization part by my self for 2 months until more people got hired.

  • @fouadS31
    @fouadS31 Pƙed rokem

    Man thank you , thaank you thaaank you ❀

  • @HarshvardhanKanthode
    @HarshvardhanKanthode Pƙed rokem

    I thought this was going to be just another skit or something. Brilliant analysis of real world roles!

  • @alfredoguerrero1208
    @alfredoguerrero1208 Pƙed rokem

    incredible video!

  • @fadimessi10
    @fadimessi10 Pƙed rokem

    Videos like these are very insightful

  • @philipogunmola9333
    @philipogunmola9333 Pƙed rokem

    I will love to see more of this

  • @nationhlohlomi9333
    @nationhlohlomi9333 Pƙed rokem

    You always do practical and this is so helpful bro❀

  • @theviewsx
    @theviewsx Pƙed rokem

    You are talent embodied!

  • @danzielcempron2589
    @danzielcempron2589 Pƙed rokem

    Thank you so much for creating such valuable content. :>

  • @fiveguys540ee
    @fiveguys540ee Pƙed rokem

    deepnote is a life saver ..

  • @kabelo3231
    @kabelo3231 Pƙed 4 měsĂ­ci

    This is informative thank u

  • @theophilusakugre3936
    @theophilusakugre3936 Pƙed rokem

    Wow Thank you
    This is soo informative 👏 👌 A to Z

  • @joycegemcanete7217
    @joycegemcanete7217 Pƙed rokem

    This makes me less scared of learning DS. Thankyou!!

  • @ishandandekar1808
    @ishandandekar1808 Pƙed rokem

    Hey Shashank, loved the video. Can you show a tutorial to actually connect to s3 buckets with python code rather than using a GUI?

  • @bellaeke1010
    @bellaeke1010 Pƙed rokem

    Great Content!

  • @memorian1024
    @memorian1024 Pƙed rokem

    Lol the MS Teams sound, made me instantly press ctrl + w :D

  • @kcdavis3812
    @kcdavis3812 Pƙed rokem

    Great breakdown between the different roles.

    • @ShashankData
      @ShashankData  Pƙed rokem

      Thank you so much! I'm glad it was helpful

  • @aryanambastha4050
    @aryanambastha4050 Pƙed 9 měsĂ­ci

    It would be amazing if you could give us a roadmap video for Data Analyst for 2023!

  • @jaikrishanbhardwaj5841
    @jaikrishanbhardwaj5841 Pƙed rokem

    Shashank you are the TOP G of Data people

  • @NoneNoone-jc6cv
    @NoneNoone-jc6cv Pƙed 11 dny

    awesome video

  • @DreyKeepItReal
    @DreyKeepItReal Pƙed rokem

    This is definitely motivation when you show your process and thought process of these fields
 Some of us Americans wanna do better


  • @LukeBarousse
    @LukeBarousse Pƙed rokem +3

    Loving the NASA jacket! 😜

  • @sametcelik8075
    @sametcelik8075 Pƙed rokem

    You know what, it's a great video.

  • @zahir4215
    @zahir4215 Pƙed rokem

    Amazing!!!!!!!

  • @joelhedtjarn9
    @joelhedtjarn9 Pƙed rokem +1

    Forecasting never ceases to break my brain. The linear regression model predicted an overall downward trend, and yet this magic Prophet seemed to indicate that the next couple of months will be trending upwards. I'd personally have a hard time explaining to a bunch of executives how/why Prophet reached that conclusion, i.e. why did they see a downwards trend and why don't we think that it will continue in the next quarter, which seemed to be what the executives in this scenario were interested in. How would you go about figuring that out, and how would you go from a set of plots to a finished writeup?

    • @ShashankData
      @ShashankData  Pƙed rokem +3

      So forecasting really is an art as much as it’s a science. Linear models can’t take into account seasonality and cyclical like the Prophet model can. I purposefully used the linear model to show how you start simple and move from there but realistically basic linear models don’t work too well for a lot of forecasting results

  • @obakengamos8635
    @obakengamos8635 Pƙed rokem

    👌 wow
    Awesome

  • @emresahindance
    @emresahindance Pƙed rokem +1

    Thats me right there playing eu4 instead my fellow gamer scientist

  • @AvgDietCokeEnjoyer
    @AvgDietCokeEnjoyer Pƙed rokem

    You are amazing and I love you.

  • @montassarbenkraiem3029
    @montassarbenkraiem3029 Pƙed rokem

    I have a suggestion can you provide for us a tutorial how extract structured data from unstructured ones and thank you very much

  • @user-bz7fj1fk2m
    @user-bz7fj1fk2m Pƙed rokem

    U R all blessed minded, MAY GOD BLESS U IN ABUNDANCE!!!!!

  • @tavaanaenterprises1882
    @tavaanaenterprises1882 Pƙed rokem

    These three roles cannot be explained better than this. I have one question. Does a person go on Data Engineer role directly or he / she is promoted from the DA or DS roles? Thanks for the efforts you put into this video creation.

  • @idnessi
    @idnessi Pƙed rokem +1

    Amazing stuff. Thank you for breaking it down in a way that beginner would understand. In your opinion, is Data Analyst the entry level to the rest of the group or are they all part of different disciplines? Would love to know what to learn first to get into this field. I am coming from HR environment so not much exposure to raw data and big data. Appreciate your content always!

  • @vectoralphaSec
    @vectoralphaSec Pƙed rokem +1

    Just discovered your channel. You seem like a cool knowledgeable person on this topic. So im wondering if you can help me with a question i have. So I am a recent graduate in Computer Science and want to instead go into Data Science industry instead of the traditional Software Developer/ Software Engineer career. So as someone like me who eventually one day wants to work in data science industry, is there an entry level job role that one can apply as a starting point and just get promoted/ level up to a data science in time rather than just trying to apply for a data science position from the get go? I dont mind starting at the bottom and working my way up the ladder. If anyone else have any suggestions i would greatly appreciate it?

  • @cincomill4230
    @cincomill4230 Pƙed rokem

    Every data enthusiast should watch.

  • @abderrahimba7390
    @abderrahimba7390 Pƙed rokem

    love you bro from morocco

  • @Typezero73
    @Typezero73 Pƙed rokem

    Can you make a video on how to become a data scientist.

  • @divyaranjanmallick2637
    @divyaranjanmallick2637 Pƙed rokem +1

    Which role is best suitable for freelancing ?

  • @abhijitprasad4740
    @abhijitprasad4740 Pƙed rokem +1

    Can you suggest how to jump from Data Analyst to Data Engineer

  • @Adi300594
    @Adi300594 Pƙed rokem

    Do you have any courses with structured curriculum, pedagogy definitely helps building from a scenario.

  • @parthmlulu1618
    @parthmlulu1618 Pƙed rokem

    Sir can you please suggest some good portfolio projects for data analytics role?

  • @thulasikurra2997
    @thulasikurra2997 Pƙed rokem

    How informatica ETL developer become data engineer.. should I learn azure and python

  • @inspiregrow2336
    @inspiregrow2336 Pƙed rokem

    Is coding /computer background needed for data science field

  • @gpt.answers
    @gpt.answers Pƙed rokem

    im a data scientist in a large not well structured company and i have to deal with the three steps :S

  • @chiragsisodia413
    @chiragsisodia413 Pƙed 11 měsĂ­ci

    Wow wow wow

  • @kalanithiv4885
    @kalanithiv4885 Pƙed rokem +125

    You’re handsome my son

  • @darksiders712
    @darksiders712 Pƙed rokem

    How in tarnation was a bucket "Your_Data" not already taken in S3 loool.