Web Crawler System Design Concepts Nobody Talks About

Web crawler System Design
What is a web crawler? how to do a web crawler system design? how to do a system design interview? What are the use cases of web crawlers? What is DDOS? What is distributed denial of service? what is rate limiting? what is DNS resolver and how does it work?
#systemdesign #systemdesigninterview #webcrawler #amazoninterviewpreparation #amazoninterview #amazoninterviewtips #googleinterview #googlesystemdesign #technicalinterview #technicalinter
Skillshare 30% off: skillshare.eqcm.net/c/5393508...
System Design playlist: • System Design Interviews
Download design: drive.google.com/file/d/1kTIv...
More information on SimHash Algorithm: • LSH.12 Simhash algorithm
Connect with me 1-1: topmate.io/pratikshabakrola
Connect with me on linkedin: / google interview questionsgoogle system design interview questionamazon system design interview questionsystem design questionweb-crawlerweb-crawlers system design web crawler

[@abiz504]

Piece of advice you could slow down a bit when explaining some concepts to allow beginners to understand system design better. Its just my perspective as i had to slow down video speed to .75 , also you can monitize by extending length of the video and trying to provide a normal speed explanation.

[@pawantiwari9710]

Best Video On Web Crawler, without doubt, good work. This channel would go to million subscribers in coming years

[@manishsakariya4595]

This channel helps great deal when you don't have enough time to prepare for the interview.

[@STONEcreator999]

No bullshit.
Only relevant things.
Beautiful explanation.
You should have put an imense effort to do this video.
Happy to see a beautiful, neat and hardworking girl like you.
Good luck 💚👍💪

[@pratikshabakrola]

Thank you 🙏🏼

[@mohanjakkula58]

Thanks for sharing. Nice video. Very well managed to touch all the relevant details to such a great extent. 👍

[@aabhinav100]

There are many other aspects that will be good to cover - Distributed crawl job quota management, determining crawl budget per URL, crawled content dedup methods, optimizing your system for network B/W or disk I/O etc.

[@gajatejeswarareddy6922]

Great content.. appreciate the details and thoroughness!

[@pratikshabakrola]

Thanks for watching!

[@bhushan8384]

Thanks for sharing!, The flow of the video is really well arranged, it kept me engaged throughout.

[@pratikshabakrola]

Glad you enjoyed it!

[@atanusamanta3835]

Thanks for sharing your valuable knowledge of web crawling. It is very useful.

[@AyanKhan-dc3eu]

Awesome video! Thanks for your time mam 🙂

[@pratikshabakrola]

Welcome!

[@saurabhmittal6947]

Hi, could you share your icons library of excalidraw.. It will be much helpful in system design interviews.

[@JuanRodrigoTorres]

You cover a lot of details in this video! not skipping any important edge case and deeply explained.
Very interesting explanation thank you so much for share this such wide knowledge, it helps a lot to open minds :)

[@pratikshabakrola]

Glad it helped!

[@Ravishar-maa]

​@@pratikshabakrola may i know the tool name which you were using for the explanation for this topic or in all the videos ?

[@lifeofme3172]

I had to go in 0.75 slow mode, some explanations are very fast.

[@user-rdr1712]

which whiteboard webpage used in this video?

[@easyvedicmaths886]

is that storage calculation is wrong? shouldnt it be 2000 * 10^12??

[@shilpanc167]

Such a great video.but background music was not needed in the video

[@HongNguyen-fj8qv]

love your courses. Thank you.

[@HongNguyen-fj8qv]

greetings from Munich.