How Dukaan moved out of Cloud and on to Bare Metal w/ Subhash | Ep 5
Vložit
- čas přidán 6. 06. 2024
- Build Your Own Redis / DNS / BitTorrent / SQLite - with CodeCrafters.
Sign up and get 40% off - app.codecrafters.io/join?via=...
Dukaan recently moved out of public clouds like AWS, GCP, and Azure are hosting their infra on bare metal instances. Like you all, I had several questions given how counterintuitive the move is. So, to get answers and understand their journey, we have with us Subhash Choudhary, Founder and CTO of Dukaan.
Outline:
00:00:00 Precap
00:00:26 Introduction
00:01:11 Story of Subhash and Dukaan
00:09:00 Infra need of Dukaan
00:11:45 Their DB setup and what do they run on cloud v/s bare metal
00:16:48 Their Kubernetes and CICD setup
00:32:22 Isn't bare metal a fixed investment and How does it scale?
00:40:00 Where and how are they hosting their bare metal infra?
00:44:18 Breaking production and Live failover
00:46:51 How did they do failover?
00:54:12 How to debug a production issue and Dukaan's Observability Stack?
00:58:43 Leveraging CDNs
01:01:42 What about security patches in bare metal?
01:03:45 IOPS benchmarking across cloud and bare metal
01:11:42 Number of deployments per day
01:13:29 Reducing infra cost from 90000 USD to 1500 USD
01:22:07 Isn't cloud more reliable than bare metal?
01:27:00 Random discussion on databases
01:36:24 Like, Share, and Subscribe
Arpit's System Design Masterclass
System Design for Beginners: arpitbhayani.me/sys-design
System Design for Experienced Engineers: arpitbhayani.me/masterclass
Become a member for exclusive in-depth videos: / arpitbhayani
Redis Internals: arpitbhayani.me/redis
I teach a course on System Design where you'll learn how to intuitively design scalable systems. The course will help you
- become a better engineer
- ace your technical discussions
- get you acquainted with a massive spectrum of topics ranging from Storage Engines and high-throughput systems, to super-clever algorithms behind them.
I have compressed my ~10 years of work experience into this course, and aim to accelerate your engineering growth 100x. To date, the course is trusted by 1000+ engineers from 13 different countries.
Together, we will build some of the most amazing systems and dissect them to understand the intricate details. You can find the week-by-week curriculum and topics, benefits, testimonials, and other information here
arpitbhayani.me/masterclass.
Other links
If you have solved an interesting problem and want to talk about it on my channel, check out
arpitbhayani.me/podcast
CS Engineering and Software Development books that I have read
arpitbhayani.me/bookshelf
Research papers that I have read
arpitbhayani.me/papershelf
Newsletter: arpit.substack.com
LinkedIn: / arpitbhayani
Twitter: / arpit_bhayani
To follow the blogs and papers I am reading, join my telegram channel at t.me/asliengineering
You can find handwritten notes and text notes about this video at arpitbhayani.me.
Until next time, stay awesome :)
Yours truly,
Arpit
arpitbhayani.me
#AsliEngineering - Věda a technologie
This is truely an insane podcast!
Subhash by default speaks in 1.5x
His brain works faster than his speech
yep. I wanted to watch in 1.25x or 1.5x but couldn't understand him
i had to listen on .75 to understand
I literally checked if I’m on 1.5x
Same..instinctively i put the video on 1.5x as soon as it started but had to switch back once he started speaking 😂
This is literally crazy podcast, I do not think i have finished any podcast without a break ever till this one arrived. A good start to the weekend. Thanks Arpit for doing this.
Same, 1st podcast I completed.
I hope Arpit bring more content like this (not necessarily in podcast) but practical hands on for "asli engineering"
Bro this cto is dope.... knowlege...curiosity....fearlessness...man insane... kudos to him...Thank you Arpit bhaiya for this podcast
Man he is knowledgeable and confident enough to show the inside workings of his company.
Really respect him
Never saw a world class dev process explained in plain Hindi like this before . Also please see if sensitive info is not being shown. ❤
This is peak of youtube! SO MUCH KNOWLEDGE in a SINGLE VIDEO!
I was like I will watch for 10 mins till my snacks would be finished and now I am having dinner watching this. Man, please do more podcasts like these. Got to learn a different thought process . Thanks Subhash and Arpit !! I hope to see more such podcasts on the channel.
This CTO is amazing! Very inspiring and logical and keeps things simple! Ankit thanks for bringing this, looking for more
This discussion was really a gem, from my experience what i have observed is when people talk about response time, everyone gets so defensive that the first point of check is either code, or query run time, adding multiple indexes to make the the query run faster, but we easily ignore the network calls most of the time. Some great take aways from this discussions for sure.
What a brilliant podcast! Didn't shy from disclosing the real numbers... no one want's to find out the hard way. You and Subhash are proper engineers and I loved listening to you two talk technology. I've been a generalist for about 20 years, but love to experiment. I've learnt to setup servers etc. only since covid. So while my knowledge is surface level compared to you'll it was interesting to know that my learning is in the right direction. And just like you, i was astonished with the IOPS difference! Anyway, thank you for a wonderful podcast.
Its real gem, loved it Arpit and Subhash. Anticipating more.
It's been great working with Subhash. Really glad to be a part of his impressive operation.
pure knowledge..pure passion !!
no doubt why this video is most viewed in this channel..
One of the best podcast. I can say this is asli engineering and Subhash is very confident and fearless, "Fatega to dekha jayega, Zarurat hi ku h, complex krna hi ni h" 😄and he literally shutdown the actual server for the demo. I learnt, do not over design the architecture, just see the data and build.
Man this video is insane. I thought I'll watch first 30 mins or so and sleep. But I couldn't skip any single minute. I've literally been doing engineering for last few years but it was all about writing code and code level optimisations but no one ever talks about these optimisations from the perspective of costs, thinking in such a way from first principles is really 'Asli Engineering'. From the insights from Subhash to the insights from Arpit at the end. It was super amazing. Ive never commented on any youtube video before, creating a channel just to comment on this one. Subscribed to your channel as well. Amazing video loved it!
I recognize this writing
I'm less knowledgeable to this topic. So 10pm k around video start kiya aur 1:11am ho rha hai. 1hr 37 min ka video ko dekhne mai itna time laga...
so many thing for me to know. bahut se unknown terms ko google search kr kr ke dekhna pada.learned many things. Plz keep it up !
Insane. Hands down the most entertaining and enlightening podcast I have ever seen.
Amazing ! In my recent experience working in a similar company to Dukaan but for the Middle East region. They have struggled alot to reduce the cost of AWS bills, this is the real pain for startups. Eye opener this is called "Asli Engineering" hats off, we need more podcasts with Subhash .. Already a fan of him
It's great to see.
Wow, this is really good conversation.
Thank you Subhash for being so open.
We would like to see more of this kind of in-depth sessions it was really awesome to watch you guys.
Showing the internal infra setup on CZcams was the highlight.
Bring more of these kind of stuff.
This is one of the best Tech discussion I have ever seen on youtube.
This is the best engineering podcast I have ever seen in my life! Inspirational!! ❤
This was pure awesome. Loved every second of it ❤.
This is a magical discussion!!! Man, this is an awesome podcast. I have Subscribed to the channel and turn the notifications ON, and kept shooting such podcasts. Really knowledgable.
Subhash's approach towards the problems and their solutions and preparedness is just awesome. I very rarely comment on any videos but on listening to his realistic approach prompted me to comment. Really impressed by the unencumbered way of thinking. All the best to Dukaan and Kudos to "Asli Engineering by Arpit Bhayani" for this interaction.. 👍
After a long time I watched this long podcast at once! This was truly an amazing content. Thoroughly enjoyed listening to both of you. Thank you!
Next level podcast💯🔥. I hope you continue inviting such talented people. Learnt alot🙌
This was an amazing podcast. Hats off to how Subhash so easily touched so many aspects of Infrastructure.
Was so eagerly waiting for this episode!
my first podcast ever, and its full of knowledge.
Amazing CTO with tonns of knowledge and daring. Looking forward to work with him.
Damn !!! This is insanely good discussion ... Absolutely loved it !!! Subhash proved that we can have full control of our Infra instead dumping loads of money into Cloud vendors !!! This was real fun ... keep them coming !!!
Enjoyed the whole discussion, bring more like this!
Even though I didn't want to I had to pause the video and then like it before being mesmerized again 🔥🔥🔥
you've earned a subscriber by introducing me to a new type of podcast. The cocktail of education and interview is very refreshing.
Maza aa gya, soo much depth shared in a way like chai sutta aur charcha. Appreciate Subash for sharing things so transparently ❤
very nice podcast, the people of my generation who started their career from cloud era only couldn't compare the bare metal and cloud performances and this is eye opening thing to see. great subhash sir
Great Podcast, very enlightening even to someone who has very less knowledge about cloud Kudos to both 👏
Crazy stuff , and crazy excitement , this shows how deeply he has done the things
This man has what a clear understanding of thoughts... really impressed to know how things work.
This channel is underrated and this content is Gold
This was a really good podcast, Arpit. As an old IT guy, I always knew self hosting is cheaper. But these insights from founder were phenomenal.
I work for a cloud provider so this is counter intuitive to I profess in general. However, the simplicity and ease with which Dukaan manage their infrastructure is amazing. My favorite thing was Subhash's enthusiasm for all this and how he takes pride in his tech work, truly inspiring!
I only worry about rapid scaling ability in future, however if the company doesn't project such an exponential growth, then this would work well for a foreseeable future.
You Indians are gold-mine of knowledge. Love you both from across the border.
Thanks guys for this discussion. Aaj neend achi aayegi. Invaluable insights from Shubhash !
Really loved this podcast, This man is truly passionated for engineering.
This is truly “Asli Engineering” ❤
Are mere bhai…🤯🤯 itni humbleness..❤️❤️❤️
very informative, we want more content like this. And thanks to Subhash sir for sharing such an amazing info
Great grip on his domain , a real guru .. love from Pakistan....
Hats off you guys, literally I loved them this is what our Indian Software developer community needs ❤❤
This is the first channel to which I have subscribed while watching this video.
Great work Dukaan team, one of the best podcast out there. Keep posting 💥💥💥
ok pranav
This is 🔥🔥. Didn't expected that this will change my entire though process. The content of this podcast is of worth entire eng. degree.
This is literally an eye-opener!!
I'm not even a CS engineer but I am all here for this kind of content.
what a podcast ! truly amazing .
He is so incredibly honest. Lovely talk.
Why this podcast is what I was looking for all the time!!
What an amazing podcast! Really inspiring!
I don't know you, I don't know this guy. I clicked on the video just by reading "Dukan". As an early stage engineer myself, this is a gem 💎 podcast on devops and cloud infrastructure. Got a lot of insites. Totally worth it my time! Looking for more valuable content like this now! ❤ 🔥
What a gem of a podcast!!
Subscribed befor I hit play. Something told me it was going to be worth it. Great content.
Bro this is really dope podcast. Subhash is genius guy.. Never saw such a simple thinking can solve a big problem.
Thanks Asli Engineer for doing this podcast. I became a fan of Subhash Chaudhary from now.
Kya confidence hai!!!! Zabardast.
Insane podcast…Weekend well spent
What an amazing podcast!!! Subhash sir is just on another level. Loved it throughout.
Throughly enjoyed the entire podcast, thank you!😊
Knowledgable! I am also working on my startups it could give new startups a knowledge of future and critical thinking about their systems. Great!
Hello Arpit!
Anycast is such an intriguing topic, and I couldn't agree more. I'm definitely looking forward to another video on BGP Anycast details. Your content is always so informative and well-explained. Keep up the great work! 🔥👍
Good one - Arpit, I was same thought and this bost my thoughts and lot of practical and proven insights form Subhash, Thank you
Very Nice thought process Subhash ... very real and very inspiring.
Bro this is a kind of podcast i was really searching for. Thanks mann
This was great. Please keep this coming :)
The guy gave a thorough overview of GitOps, ArgoCD, and Kubernetes principles. This video is more a tutorial than a podcast. ❤
Bhai, meri shuruvat ese hi hardware si hui thi, bad me cloud me move kiya and started focusing there. But this gives me enough confidence to continue on hardware.
Already downloaded video for reference purposes.
lot of information in a single video. just wow!
oh man that was a crazy one session tooo good. CTO is just amazing
Asli Desi Engineering, hats off to you guys 👌👌
I am planning the same, I spent 5 years learning about deploying on-premises servers now it's time to use it.
Man this is dope! Would love to see a follow up podcast where we could see the database architecture. As in, are the databases sharded for a set of shops? Are all the app server regions of the same service hitting a single primary db?
Would love to watch more podcast of Subhash Choudhary.
I am flattered by this podcast. Thanks Arpit for this podcast. One of the most amazing podcast i have got lots of learnings from..
This guy knows his stuff, awesome...
the moment he mentioned $1500 I was shocked, I've worked on both on-prem and cloud, currently working on the performance side of the applications but with these insights I will always check the underlying hardware as well.
Thanks for bringing such content. ❤
Thank you very much for this awesome and inspiring podcast ❤
Very informative video man, would love more of such videos/podcasts. Thanks 👍
There are more than 160 such videos on my channel. Do go through them. I have covered deep engineering concepts and real world systems.
@@AsliEngineering Oh, I will go through, Thanks 👍
It's never a good content on the channel, it's always the best 😅🤣. Great insight 👍👍
Bhaisahab.. bawal kaat diye hain ekdum 😆
Kudos to Subhash for thinking in a very different and very realistic approach. Loved the podcast. and best of luck to you arpit for your analytical db endeavour 😀
Thank you Deependra 🙌
My mind is blown , got to learn so many stuff my brain can't handle!!
Wow, Full Interesting Podcast .
Maza aa gya .
I hope they make a similar episode when they go back into the cloud.
from a random recommendation landed on this and 20 mins of video made me subscribe you
hatsoff to the dukkan's founder..that deep insight will help people like us who are self taught
Awesome podcast. Please do this kind of pod
This podcast is Insanely Great!!!!!!!
Bhai! amazing! Subhash is a great guy!
Just wow ! The honesty 👏
This is Tanenbaum's book done bottoms up. Great talk, insight, guts and engineering.
Does that book also cover these kinds of topic? I didn't read that much. But IIRC, it was about the computer stack bottom up