Gaurav Sen
Gaurav Sen
  • 296
  • 29 016 770
30 [Software Engineering] research papers you should read
You can find all the papers listed here:
interviewready.io/blog/white-papers-worth-reading-for-software-engineers
Here are 30 whitepapers worth reading for software engineers. These papers are dense sources of information.
Most are from Google and Meta, but you see the occasional Amazon or LinkedIn paper. Keep an eye out for the topics you like.
Gotta read them all!
00:00 Whitepapers
00:12 30. Scalability at what COST
00:50 29. Detection of Silent Data Corruption
01:20 28. Prophet
01:57 27. Napa
02:26 26. Cubrick
03:00 25. Monitoring and Root Cause Analysis
04:00 24. Presto
04:40 23. Foundation DB
05:16 22. F1 Lightning
06:16 21. LinkedIn Distributed Graph
07:15 20. TensorFlow
07:30 19. The monolith strikes back - Istio
08:25 18. HALP - CZcams CDN
09:18 17. Monarch
10:16 16. Dapper
10:51 15. Gorilla DB
11:17 14. Zanzibar
11:55 13. Scaling Memcache at Facebook
12:45 12. SIEVE vs. LRU
13:40 11. Twitter cache clusters
14:28 10. Amazon Firecracker
15:10 9. Spanner
15:30 8. Dremel
16:08 7. Google File System
16:50 6. BigTable
17:24 5. Hive Warehousing Solution
17:52 4. Pregel
18:18 3. TAO
19:00 2. End-to-End Path CDN Performance
19:52 1. Google Backend Subsetting
Useful links:
Github: github.com/InterviewReady/system-design-resources
Twitter: gkcs_
#SystemDesign #WhitePapers #Research
zhlédnutí: 6 569

Video

Find the distance between friends/connections - LinkedIn System Design with @KeertiPurswani
zhlédnutí 8KPřed měsícem
Have you noticed a small icon on the right of LinkedIn profiles? It tells you how closely you are related to a user (1st, 2nd or 3rd-degree connection). These distances are calculated using graph algorithms. Specifically, LinkedIn uses Bi-directional BFS. This is a two-way algorithm where a search is started from both source and destination, and terminated midway. The total distance traveled fr...
System Design of a Delivery System like Zomato with @KeertiPurswani
zhlédnutí 14KPřed 2 měsíci
In this video, we look at what powers the delivery and tracking systems of e-commerce apps like Zomato, Swiggy, and Amazon. Along the way, we go through relevant spatial algorithms, network protocols, and design components used in location-based systems. Cheers! 00:00 Problem Statement 00:45 Requirements 02:00 High-Level Design 04:01 Capacity Estimation 05:36 Location-Based Queries 13:30 Tracki...
System Design of GitHub Code Search - SDC Episode 1 with @KeertiPurswani
zhlédnutí 11KPřed 2 měsíci
Github code search allows developers to view and edit code online. This is particularly useful when debugging code in remote locations (like on vacation)! GitHub manages permissions, storage, and retrieval through a set of services. In this video, we look at systems that power its search APIs. If you have any doubts or suggestions, please share them in the comments below. This is the first epis...
Latency Numbers Every Programmer Should Know - 1000x slow-down
zhlédnutí 11KPřed 6 měsíci
These are some latency numbers every programmer should know. 00:00 Memory and SSD 00:13 Sequential Disk Read 00:33 Roundtrip CA to Netherlands 02:48 Roundtrip CA to India 06:08 Ends Git Gist: gist.github.com/jboner/2841832 System Design: interviewready.io/ Designing Data-Intensive Applications Book: amzn.to/3SyNAOy Twitter: gkcs_ #SystemDesign #Software #Coding
The Most Advanced Multiplication Algorithms: Why Karatsuba and FFT beat high-school mathematics
zhlédnutí 4,6KPřed 6 měsíci
For folks interested in multiplication algorithms (turns out this is a big deal in computer science and math). 1. High school method - O(n^2) 2. Karatsuba - O(n^1.58) 3. Toom-Cook - O(n^1.46) 4. FFT - O(n*log(n)*log(log(n))) The last algorithm is pretty complex. We explain the intuition behind it in this video. 00:00 Who should watch this? 00:18 Example Problem 01:23 Karatsuba Algorithm 02:38 T...
Coding Interviews must be FIXED [Open to Thoughts and Suggestions]
zhlédnutí 14KPřed 7 měsíci
Software Interviews need a revamp. Coding rounds are IRRELEVANT to our jobs. On average, software developers spend three months preparing for an interview. A good engineer has to choose between: 1. Focusing on the job. 2. Practice useless DSA questions. It's time to ask job-relevant questions and test candidates' WORKPLACE capabilities. At InterviewReady, we are building tools to test engineeri...
How ANOMALY DETECTION works in time series using the Holt-Winters Algorithm
zhlédnutí 4,3KPřed 7 měsíci
This video explains how anomalies are detected in a time-series graph. The algorithm's name is Holt-Winters. The idea is simple, and the results are often useful. Cheers! 00:00 What is a time series? 00:30 How can we find anomalies? 01:00 Anomaly Detection Algorithm 02:25 Repeated Differentiation 03:36 Example 04:14 Thank you! #anomalydetection #timeseries #monitoring InterviewReady: interviewr...
20 AWS services you should know [as a Software Engineer]
zhlédnutí 28KPřed 7 měsíci
20 AWS services you should know [as a Software Engineer]
A SUPER FAST tech stack for startups [using AWS and Payment Gateways]
zhlédnutí 21KPřed 7 měsíci
A SUPER FAST tech stack for startups [using AWS and Payment Gateways]
20 Whitepapers that changed the world [For Senior Software Engineers]
zhlédnutí 128KPřed 8 měsíci
20 Whitepapers that changed the world [For Senior Software Engineers]
Design Patterns for High Availability: What gets you 99.999% uptime?
zhlédnutí 22KPřed 8 měsíci
Design Patterns for High Availability: What gets you 99.999% uptime?
Tech that DOESN'T WORK for Start-ups and Mid-sized companies
zhlédnutí 17KPřed 8 měsíci
Tech that DOESN'T WORK for Start-ups and Mid-sized companies
Authorization across Distributed Systems: The OAuth Protocol
zhlédnutí 20KPřed 8 měsíci
Authorization across Distributed Systems: The OAuth Protocol
How Stored Procedures make databases BLAZINGLY FAST
zhlédnutí 16KPřed 9 měsíci
How Stored Procedures make databases BLAZINGLY FAST
Garbage Collection Algorithms in Java: Concurrent Updates with Optimistic Locking - Part III
zhlédnutí 8KPřed 9 měsíci
Garbage Collection Algorithms in Java: Concurrent Updates with Optimistic Locking - Part III
How 100 milliseconds cost Amazon 3 BILLION DOLLARS: Latency, Concurrency and Parallelism
zhlédnutí 51KPřed 9 měsíci
How 100 milliseconds cost Amazon 3 BILLION DOLLARS: Latency, Concurrency and Parallelism
Impeccable API Design: What you MUST CONSIDER before deploying APIs to production
zhlédnutí 23KPřed 9 měsíci
Impeccable API Design: What you MUST CONSIDER before deploying APIs to production
What is an API Gateway?
zhlédnutí 48KPřed 9 měsíci
What is an API Gateway?
Career Choices: Four differences between Managers and ICs
zhlédnutí 13KPřed 11 měsíci
Career Choices: Four differences between Managers and ICs
How custom banners are shown INSTANTANEOUSLY: Contextual Advertising at Scale
zhlédnutí 22KPřed rokem
How custom banners are shown INSTANTANEOUSLY: Contextual Advertising at Scale
Running a bootstrapped startup for 3 Years: The story of InterviewReady!
zhlédnutí 9KPřed rokem
Running a bootstrapped startup for 3 Years: The story of InterviewReady!
Dark Mode: Pilot Launch at InterviewReady
zhlédnutí 2KPřed rokem
Dark Mode: Pilot Launch at InterviewReady
Zerodha Stock Broker System Design with @KeertiPurswani
zhlédnutí 30KPřed rokem
Zerodha Stock Broker System Design with @KeertiPurswani
Task Management - The one thing you must know as a software engineer
zhlédnutí 16KPřed rokem
Task Management - The one thing you must know as a software engineer
10 steps in the career of a software engineer: From SDE-1 to Principal Engineer
zhlédnutí 84KPřed rokem
10 steps in the career of a software engineer: From SDE-1 to Principal Engineer
Front-End to Full-Stack: 9 Different Types of Software Engineers
zhlédnutí 24KPřed rokem
Front-End to Full-Stack: 9 Different Types of Software Engineers
8 Rules for Offer Negotiations by Gaurav Sen
zhlédnutí 62KPřed rokem
8 Rules for Offer Negotiations by Gaurav Sen
Let's get InterviewReady!
zhlédnutí 19KPřed rokem
Let's get InterviewReady!
CS Grad Placement Roadmap: First Year to Fourth Year
zhlédnutí 16KPřed rokem
CS Grad Placement Roadmap: First Year to Fourth Year

Komentáře

  • @lettechtutorials
    @lettechtutorials Před 21 hodinou

    Agreed

  • @raghavendrac4710
    @raghavendrac4710 Před 21 hodinou

    Amazing explanation Sir!

  • @vickyanand5898
    @vickyanand5898 Před 22 hodinami

    Rollback sent by the leader can fail as well right ? Near to 23rd minute

  • @JEEVRAJTARALKAR
    @JEEVRAJTARALKAR Před dnem

    If senior developers are just 1-2 years experienced. They tend to bully junior engineers in code reviews

  • @aryankr
    @aryankr Před 2 dny

    kudos to your work on the topic.

    • @gkcs
      @gkcs Před 2 dny

      Thank you!

  • @divyanshubhaskar4657

    Can we choose BLOB over Amazon s3

  • @Varun-ij2pp
    @Varun-ij2pp Před 2 dny

    Its great to here. Have a suggestion. Why cant you make a saas product and sell like thinkific? with your experience. You already know all the challenges and solved them.

    • @gkcs
      @gkcs Před 2 dny

      Thinkific requires tremendous customisation capabilities to be useful. It isn't a business I'd like to get into, because I don't see content creators stick around long enough.

  • @AlooThisSide
    @AlooThisSide Před 2 dny

    Gaurav, I need further clarification for following points:- 1. Dirty reads and Dirty Writes 2. Trade-offs.

    • @gkcs
      @gkcs Před 2 dny

      Please elaborate, Mr. Aloo :)

    • @AlooThisSide
      @AlooThisSide Před 2 dny

      @@gkcs Just wanted to know what does these terms means wrt system Design. ✌

  • @sougatakundu8507
    @sougatakundu8507 Před 2 dny

    Audio n video quality needs to be improved.

  • @clarangelical.618
    @clarangelical.618 Před 3 dny

    thank you so much! loved the energy and delivery.

    • @gkcs
      @gkcs Před 2 dny

      Thank you!

  • @AK-wo3uw
    @AK-wo3uw Před 3 dny

    Hey Gaurav, great video, it was very relatable as I am too working at an early stage startup we are trying to build an ERP software, here our tech stack is very pre mature we are using EJS for server side rendering of web pages, ExpressJS, MySQL and elasticsearch for generating search suggestion over a 4.5 lakh records for product name, here are struggling with managing elasticsearch as its costs us a lot and we tried building algorithm for generating search suggestion using mysql but its spiking the cpu just over 2-3 users, can you please advice me here or suggests some resources. Also what tech stack should I choose if we wish to scale this software further.

  • @harsh_garg
    @harsh_garg Před 3 dny

    Hi, you mentioned how we determine online status, what if the user opened the whatsapp but hasn't done any activity post that on whatsapp, just sitting idle [how we determine online status as per the discussion], but still online.

  • @roshnishaikh8954
    @roshnishaikh8954 Před 3 dny

    What is point number 6 and 7 abt fear can u explain more

  • @sukhpreetsingh2818
    @sukhpreetsingh2818 Před 4 dny

    😁😚🥲

  • @hakunamatata-nl4js
    @hakunamatata-nl4js Před 4 dny

    thank you for to the point videos

    • @gkcs
      @gkcs Před 4 dny

      Cheers!

  • @sathwikabhignan1862

    oh man, you are something else, fantastic explanation!!!

  • @pinturavidas7669
    @pinturavidas7669 Před 4 dny

    Thank u so much!!! from scaling a system from scratch to distributed environment. Loved your video😍

    • @gkcs
      @gkcs Před 4 dny

      You are welcome :D

  • @pinturavidas7669
    @pinturavidas7669 Před 4 dny

    Wonderful explanation!! You are having such a deep understanding of computer worlds. Please keep updating some videos. Thanks

    • @gkcs
      @gkcs Před 4 dny

      Thank you :D

  • @AnikBanerjeeliveforfun

    Not helpful video ... as if he is reading from book