Map Reduce explained with example | System Design

Sdílet
Vložit
  • čas přidán 2. 02. 2023
  • In this video I explain the basics of Map Reduce model, an important concept for any software engineer to be aware of. This will help you identify and apply Map Reduce related questions during your System Design Interviews
    Map Reduce Paper: static.googleusercontent.com/...
    Follow me on LinkedIn: / bytemonk
    System Design Interview Basics Playlist:
    ► • System Design Intervie...
    AWS Certification:
    ►AWS Certified Cloud Practioner: • How to Pass AWS Certif...
    ►AWS Certified Solution Architect Associate: • How to Pass AWS Certif...
    ►AWS Certified Solution Architect Professional: • How to Pass AWS Certif...

Komentáře • 64

  • @shriyaananthanarayanan
    @shriyaananthanarayanan Před rokem +30

    thank you so much, today i went to my first day of internship as a 15 year old girl and didn't get the complicated words they explained me but u thought me in a way I will never forget in my whole life.
    thank you so much!!!!

    • @chanwoopark5397
      @chanwoopark5397 Před 5 měsíci +19

      where in the world are 15-year olds doing internships that involve map-reduce?? that's wild

    • @jasonwang-wg8wu
      @jasonwang-wg8wu Před 4 měsíci

      15 is the new 18 (pause)@@chanwoopark5397

    • @backslash8874
      @backslash8874 Před 3 měsíci +8

      15 year olds, doing internships, and dealing with MapReduce and distributed systems. My 25 years old senior software engineer @$* not being able to comprehend the situation. Which world you live in mah lil sister?

    • @shriyaananthanarayanan
      @shriyaananthanarayanan Před 3 měsíci

      @@chanwoopark5397 I did the internship in my brothers company so... It wasn't that hard for me to get in...

    • @shriyaananthanarayanan
      @shriyaananthanarayanan Před 3 měsíci

      @@backslash8874 brotha, it's just like 3 months internship wasn't that hard, my brother is the owner of the company so he just accepted to let me in. I was told to do a couple of work and understand d the concept first, I tried my best to go to internship coz I wanna become a senior like you. And see, that's the difference, I will introduce myself as a intern not a senior like you. 🤗🤗
      I really admire you guys,🤗🤗 I waiting to finish my education and I wanna work! Infact I'm kinda girl who watches "the office"😂😂

  • @fishfanaticgokul4758
    @fishfanaticgokul4758 Před 7 měsíci +6

    Most excited video of 2023 for an diagrammatic representation and clear cut explanation ❤❤❤ really great. College staff wants people like you to teach.

  • @user-cn1vt9qo9e
    @user-cn1vt9qo9e Před měsícem +3

    The professors we want in Indian engineering colleges ❤

  • @nanaarhin5567
    @nanaarhin5567 Před 8 měsíci +4

    The most complex name explained with the most simplest scenario. I understand this better now

  • @ethanxie2737
    @ethanxie2737 Před rokem +3

    finally i know what is MapReduce, thanks !

  • @rookie2048
    @rookie2048 Před 4 dny +1

    I love you man
    Such a clean explanation

  • @manmeetworld
    @manmeetworld Před 3 dny +1

    Best one I've seen yet

  • @abasahebbhingardeve5464
    @abasahebbhingardeve5464 Před rokem +7

    Very clear and understanding explanation.

  • @mikedelta658
    @mikedelta658 Před rokem +5

    What a wonderful explanation!

  • @Sanjaysview
    @Sanjaysview Před 8 měsíci +3

    What a quality sir, hand off

  • @kunalsoni7681
    @kunalsoni7681 Před 8 měsíci +1

    this video made a complex topic in a very simpler way ♥️☺️💯

  • @user-yk9rr5ir7v
    @user-yk9rr5ir7v Před rokem +2

    Thank you for this! I have a data engineering interview tomorrow and the example really helped me understand the concept well enough to be able to explain it myself if I am asked.

    • @ByteMonk
      @ByteMonk  Před rokem +1

      my latest video on data platform might also help you prepare for the interview, all the best!

  • @nikhilpathak1948
    @nikhilpathak1948 Před 3 měsíci +1

    I watched many videos but your's 🔥🔥.
    I understood, thankyou!! 👏😊

  • @p33yush
    @p33yush Před rokem +3

    Thank you for awesome explanation!

  • @johnnyc5467
    @johnnyc5467 Před rokem +3

    This is a great video. Thank you!

  • @nizarhabib4352
    @nizarhabib4352 Před 18 dny +2

    Very nice explanation

  • @ilhemwalker9145
    @ilhemwalker9145 Před 8 měsíci +1

    thank you so much it's clear and well explained you answered all my whys and whats

  • @aymanelouazzani4245
    @aymanelouazzani4245 Před 9 měsíci +1

    thank you so much for this sample , beautiful and benefiting explanation

  • @thedragonforce2210
    @thedragonforce2210 Před rokem +1

    i lost my jaw when i saw this video , bravo , nicely done men 👍

  • @zabinoori49
    @zabinoori49 Před rokem +1

    nice explanition with all the details thanks bro 💕💕

  • @NassimDAIKH
    @NassimDAIKH Před 24 dny

    Excellent video I was looking for a simple explanation like this

  • @dhaneshpt8641
    @dhaneshpt8641 Před 4 měsíci +1

    Super presentation.. Thank you sir.

  • @HLearningFun
    @HLearningFun Před 7 měsíci +1

    very nice and informative and detailed. thanks.

  • @avasingh764
    @avasingh764 Před rokem +1

    His Voice ❤❤️🔥🔥

  • @samathaea8264
    @samathaea8264 Před rokem +2

    Very helpful. thank you:)

  • @cynthiabock9104
    @cynthiabock9104 Před 7 měsíci

    Thank you for this super helpful video!
    What I have not understood yet is, how can I turn the process back? For example, if I am looking at the output file, how do I know in how many of those input files has the word 'apple' been? From what I understood, it could have been twice in the first (or second) file or once in each.

  • @landocodes
    @landocodes Před 4 měsíci +1

    Amazing explanation!

  • @emmanuelyaro8322
    @emmanuelyaro8322 Před 27 dny +1

    thank you so much, very clear

  • @dimon_z
    @dimon_z Před rokem +2

    Bro you are awesome 👍

  • @codernew3191
    @codernew3191 Před rokem +1

    This is what I wanted

  • @yashthakur5712
    @yashthakur5712 Před 6 měsíci

    Excellent explanation

  • @vaibhavahuja4001
    @vaibhavahuja4001 Před rokem +1

    great vid. thanks

  • @jasonwang-wg8wu
    @jasonwang-wg8wu Před 4 měsíci +1

    @ByteMonk dank video, very clear and concise but I've got a question: at 8:20 you say we're tasked with finding all the videos with a certain number of likes. Do we really need to go through ALL of the metadata if we're just looking for the condition "number of likes >= [some amount]"??

  • @teddybear0116
    @teddybear0116 Před 7 měsíci +1

    Great video! Now do spark!

  • @samerrawashdeh1351
    @samerrawashdeh1351 Před rokem +1

    Thanks!

  • @Veigaburame
    @Veigaburame Před 10 měsíci +1

    the example is pretty straight forward

  • @shaikhuzma786
    @shaikhuzma786 Před měsícem +1

    Tqsm ☺️

  • @siyaram2855
    @siyaram2855 Před rokem +1

    🔥

  • @hermanheinz33
    @hermanheinz33 Před 9 měsíci +1

    very good video

  • @user-ie9tb4pr1c
    @user-ie9tb4pr1c Před 12 dny +1

    thank you so much, but maybe explain the example directly after the motivation next time.

  • @abhinavkrishna449
    @abhinavkrishna449 Před 4 měsíci +1

    Love you broo

  • @neostark4564
    @neostark4564 Před rokem +52

    His voice 🗿

  • @sawdawyah
    @sawdawyah Před 6 měsíci

    Thanx 😊

  • @bindukhadka
    @bindukhadka Před 2 dny

  • @InvincibleMan99
    @InvincibleMan99 Před měsícem

    Amazing explanation sir.
    Would like to know how FB store likes and comments.
    Suppose user from India likes a video, and another user from the USA likes the same video, are they stored in same place or in a sharded db (country wise), would like to know your perspective

  • @lucaterraneo7274
    @lucaterraneo7274 Před 10 měsíci +1

    nice!

  • @flameyt3721
    @flameyt3721 Před 3 měsíci +1

    Failure nodes in classic mapreduce

  • @sweethasridharan4782
    @sweethasridharan4782 Před 23 dny +1

    Damn you're voice🤌🏼

  • @complexity5545
    @complexity5545 Před 3 měsíci +2

    Is hadoop dead? Who is still using that.

    • @ByteMonk
      @ByteMonk  Před 3 měsíci

      Hadoop, in its original form, has reached a mature stage. It's less of a buzzword and more of a foundational technology upon which other systems are built. Many companies heavily invested in
      Hadoop infrastructure during its peak years and still rely on it. For example Yahoo! likely still has large-scale Hadoop systems for storage and batch processing. Facebook has also Built a huge Hadoop infrastructure for data warehousing and analytics. While they've moved a lot of processing to newer systems, legacy Hadoop clusters probably remain.
      These companies probably don't use Hadoop in exactly the same way they did during its peak. They likely have layered newer technologies like Spark or cloud-based analytics on top of their Hadoop foundations.

  • @TheBoDuddly
    @TheBoDuddly Před 8 měsíci +1

    Excellent explanation!! Thank you.