How to Scale an Application? | System Design
Vložit
- čas přidán 27. 07. 2024
- Building an application that is just going to be used by a 100 users is different from an application that is going to be used by 100k users. In this lesson, we learn about the basics of System Design and we learn how to build scalable applications. We take an example of a hypothetical application that won't scale and gradually scale it to support high traffic while learning all the intricacies along the way.
0:00 Introduction
01:04 Lack of backups
02:18 Logging issues
03:07 Autorestart processes
03:35 Defaults are not always the best
03:57 Connection pooling
04:43 Integrating CDN to fix slowness
05:49 Dynamic content caching
06:08 Implement logrotation
06:37 Separate database and application servers
07:05 Split reads and writes
08:08 Handling load with Load balancer
08:48 ELK for the logs
Thank you for watching. Feel free to leave your feedback, questions, and comments in the section below and I will see you in the next lesson!
Channel website:
- roadmap.sh
Discord Community:
- / discord
Find us on the internet:
- / roadmapsh
- github.com/kamranahmedse/deve...
- / roadmapsh
Points covered:
- 01:03 Database backups to AWS S3
- 02:22 Logging
- 03:06 Auto restart processes
- 03:34 Revisit database configuration
- 04:44 Using CDN
- 05:50 Caching dynamic content
- 06:08 Implement logrotation
- 06:36 Separate servers for application and database
- 07:06 Database replication
- 08:08 Multiple application servers + Load balancer
- 08:50 Implementing ELK: Elastic Search, Logstash, Kibana
this went from an image file to one of the best educational resources concerning software development and computer science
This is lit 🔥. Evolving from a baby (single server/db) to a fully grown adult (distributed system). You have not just shown the intermediate stages of evolution for every component but have also stitched a story around it. Wow.! This video deserves millions of views.
Realistically who would be working on this? Backend application developer? Devops team? Network team? Infrastructure team? DB admins? Team lead? I am New to the industry
@@marcusaureliusregulus2833 Backend and Devops mainly , unsure about maybe network and infra
Great insights in a single video.. thanks a lot
Thank you very much! Very well explained on with examples!
Perfect for beginner, appropriately explained transitioning from basic design to scalable design adding all the other resources gradually
i love this because of the animation , examples and plain english explanation.
easy to understand and solidify the system design knowledge.
Keep up the good work
Crisp to the point.. Amazing content
I can't afford to go back to school right now so these videos are helping me a lot man. Thanks
Hmmm. Ok. That was smooth and clear. Exactly what i was looking for. Thank you
This video is very well structured. As someone who is new to system design and scalability (among other things lol), this was very helpful. Thanks a bunch!
This is the best high overview about scaling I’ve ever seen
Really like the succinct and practical explanation of this video. Very helpful and straighforward
Excellent work! Can't wait for more in-depth videos!
I haven't liked a video in my life before... until now. Please continue with this excelent work you are doing.
This is amazing, Thanks a ton. please post more system design. I love it.
the quality of your information is too amazing , thanks for the hardwork , i will be expecting more of system design
This is one of the best Video I have ever seen.
Best Ever video. Pls upload full system desing on facebook, uber , whatsapp etc.
I could not help myself, I had to subscribe immediately... This video is the best system design video I have ever seen on youtube.
This is so helpful, thank you so much... please make more advance version.
I want to learn more on scaling & maintaining system.
I watched two videos today. Both of them were very informative. I really liked the approach of explaining based on the problems statements. It helped me to relate with the issues we get into while scaling.
loved the approach of incrementally solving the problem.
Video gave me the motivation to check for more details on elastic search, kibana, load balancer, caching etc, previously I had just heard the name, but from here I am eager to spend time understanding this. Looking forward for more from you. Thanks @the roadmap.
This is an awesome explanation for beginners to scaling thank you!
Great video. Best overview for scaling an application. Kudos !
Wow, awesomely paced and information-rich content. Loved it. Thanks for making the video :)
Wow!!! Excellent overview! Enjoying your content!
This video is awesome. Shared with all of my friends.
Excellent!! Thank you so much.
really concise tutorial , great work one shot all kill!
Thanks for explaining lots of things in single video, thanks a lot....
Great video! No time wasted in explanation. Life of a web application from small to large scale.
Amazing video and comprehensive. Keep it up and running.
hahahah that was a roller coaster ride. Going super fast but I understood everything and I really liked the way you explained. Can you please cover more topics on System Design in this same fashion.
This is what I needed - excellent job on these videos!
to the point and best explanation
Amazing video on Application Scaling. Complex technology explained in most simple way. Keep up the good work :)
Wonderful buddy ...... U made scaling appear so easy. I thought it was scary .....
Thank you! There is lots of good information in this video.
Thank you ❣️ This is a fantastic explanation. Hope you will do more.
Thank you so much for such an amazing walkthrough over this complex topic. I now understand how to think in terms of scaling an application. Looking forward to having this lecture continued with advanced topics.. or an in-depth explanation as to how we can achieve the concepts explained in the video.
Oh wow, this is impressive explanation so simple and easy. Awesome stuff bud.
Exactly what i was looking for. thanks a lot
Nice and simple explanation. Thanks Kamran.
Keep it up 👍
GAIN SO MUCH KNOWLEDGE FROM THIS VIDEO. THANKS SO MUCH :THUMBSUP:
somehow I got goosebumps from watching this video kinda reminded me about my first job when I used to work 13 hours non-stop to keep fixing the freaking server/database/webapp issues.
This is an AMAZING high-level explanation. Subscribed! Now I'm waiting for the detailed explanation series 🤞
Realistically who would be working on this? Backend application developer? Devops team? Network team? Infrastructure team? DB admins? Team lead? I am New to the industry
This video was great help!
this is what i am expecting 🔥
Simply amazing!
Great explanation!
Awsome bro! You just made a fan
Hey man thanks for the video, I learned so much. It's a little bit hard to follow because you talk really fast but I accomplished to understand. Good channel
great one , thanks
wonderful video!
Excellent 💥
Amazing! Learnt a lot. Would like to know more strategies to scale if app goes further.
Perfect video That I have ever seen good job
Very Nice !!!
So cool. Subscribed
Amazing 🤩
Nice
Wow this is so cool.
Very nice
awesome video
To quote Djikstra: "When we had no computers, we had no programming problem either. When we had a few computers, we had a mild programming problem. Confronted with machines a million times as powerful, we are faced with a gigantic programming problem." :-)
Amazing video , please make new ones also like this one only , talking a in depth about node js server scaling , and using latest technologies , queues, Docker... Etc
JUST WOWW !!!
Awesome
Just love.
beautiful
Good Content, add sharding to the picture.
🤩🤩
It takes of practices to encounter all theses problems, and more years to explain them as simply and efficiently as you do (what about an Udemy course ?)
😍😍❤❤
F**k, you are holy awesome. You sum up all the backend thoughts in just 10 min video. Great!. I would love to watch more like this. Keep it up bro!!
The content is good and tells us a lot about big applications and their challenges and remediations, however somewhere in between I felt am I watching this video at 1.5x or something?
how to learn these concepts? any particular roadmap?
Great roadmap! I think the guide here (roadmap.sh/guides/scaling-databases) is wrong, according to the video. Most applications are read-heavy, instead of write-heavy, and therefore the database replication is implemented.
Manuel Nucci ah yeah there is a typo in the guide, it is supposed to say "read-heavy". Thank you for pointing out, I will fix it.
i had to turn the speed down to 0.75, this is really helpful but you speak too fast
Thank you for the feedback. I wanted to keep it under 10 minutes and thus the speed. But thanks, I will keep that in mind :)