Throughput vs. Latency: How To Debug A Latency Problem
Vložit
- čas přidán 24. 07. 2024
- Imagine you’re on call for the service you work on and you get paged in the middle of the night. Phone blaring, you stumble out of bed, sleepily turn on your computer, and look at your metrics. Looks like request latency went up a lot and users are getting errors. How do you figure out what’s going on? In this video, we’ll answer this question by looking at the relationship between throughput and latency, subtypes of latency like queuing latency, and techniques for debugging high latency. All you need is a little familiarity with software engineering. Let’s go!
00:00 Intro
00:28 Servers & Threads
00:53 What Is Latency?
01:24 What Is Throughput?
01:46 Ice Cream Analogy
02:19 Max Throughput
03:32 Queueing Latency
04:36 Server Simulation (don't miss this!)
07:17 Summary
07:58 How To Debug High Latency
08:33 Things Can Be Even More Complicated
man, these videos you make on programming, they're amazing ! Keep it up !
Agree 100%, this channel is a gem
Very nice explained and excellent animations with the graphs. I like this channel. 10/10
this is the best video i have ever seen on this topics , thanks bro
This is very helpful. Thank you Alex!
This video is dope AF!!. Thank you
Excellent video!
Good work Alex!
Great video series, please do more
thanks man
Excellent video. I’m surprised it didn’t get many likes.
well explained
Please more videos like this. Ready to join this channel too if you're activating the join or membership kinda thing
nice content
I wonder how two other illustrations might illustrate issues which can arise with servers. One: the counter clerk at the ice cream store is doing fine until one of the ice cream buckets runs empty, so they have to go get another from the freezer, and a line forms.
Two: Now the customers are angry about the line, and each one wants to register a complaint, which decreases the intrinsic throughput. So the process of getting another bucket and any decrease in throughput from the hard-frozen data (I mean ice cream) along with complaints, ends up creating bigger and bigger issues.
Hi @StudingWithAlex, Loved your videos and great animation with right context.
Can you make a video or any guide to make videos like this...
Thank You 😃😃
Great video, thanks!
I'd recommend you consider getting rid of the background music though, it's really distracting :(
Sorry about that! I've noticed the music sounds completely different depending on the speakers you're using. What speakers do you use? Does it sound loud if you listen to it on a computer or with headphones?
@@StudyingWithAlex eiiii yooo :))
On the contrary, I really like the background music. Makes it more engaging!!
nice videos
Thanks for making this!
Where can I learn more about this topic? Any good resource recommendations?
Did you find any?
Clockwork hell yeah!
godly
a good example to add is intrinsic latency is very important for gaming where to data packets are relatively small, but you want it it get to destination and back fast.. there concept difference between downloading a file vs live streaming or gaming.., Cable Internet have bad intrinsic latency..
Hey Alex - I have a code to crack and was wondering if you were able to help me at all?
does throughput care about the correctness of the output? or only churning out the date ?
Throughput is only a metric of how fast the work is done, not how good it is done, it doesn't care if it's wrong, only if it's fast. It's like in that dumb joke:
-I am the fastest counter in the world
-what's 2+2
-5
-that's wrong
-but fast
i watch these for entertainment lol
Why did you stop making videos? Please restart if you can!
Caches have entered the chat.
please lower music volume
I am not here to listen music but to listen and learn
PLEASE HELP ME -- My channel is being infiltrated from 2 persons at 06880 + others. [Some of the others: 06830].
Great video!