How Does Live Streaming Platform Work? (YouTube live, Twitch, TikTok Live)
Vložit
- čas přidán 26. 09. 2022
- Weekly system design newsletter: bit.ly/3tfAlYD
Checkout our bestselling System Design Interview books:
Volume 1: amzn.to/3Ou7gkd
Volume 2: amzn.to/3HqGozy
ABOUT US:
Covering topics and trends in large-scale system design, from the authors of the best-selling System Design Interview series.
Video capture --(RTMP)--> PoP Server -> Transcoding / Segmentation -> Packaging -> CDN distribution / Caching
Imagine you are doing R & D on a topic for the last few days and you are drowning. Then your fav youtuber came with a boat. That's happened right now. Thanks Man
I can relate to this..
There is surprisingly little content on exactly how this works from a system design perspective
There are many youtubers who have explained it in much more depth and with easy to understand approach
This is literally what just happened to me lol
Very efficient description of live video streaming I have seen so far. It's amazing how you covered this topic in about 5 mins
I would love to see architectures of Saas startups' software. Evolution of the architecture, how to scale. Thanks for your videos, there is a lot to learn from them.
Soon I'll start live streaming, and start from scratch, trying to build a SaaS product that consists out of multiple microservices. Running in a Kubernetes cluster in docker instances on AWS using Terraform, Github Actions, different backend languages/frameworks, trying to combine everything and show what that hassle of that process is, which walls you'll run into and how to solve each problem as elegant as possible.
Disclaimer: I'll try to avoid any type of JS in de backend ;)
@@tpotjj2979 cool, where can we find it?
@@barnabaslada-hartyani8998 Last week I've released my "first video" on my channel. It was my first livestream and first video edit, so thing where a bit messy, don't mind the quality of it at the moment.
Next two weeks I have vacation, bought a new Macbook and a video editing course, so I hope that quality will increase a lot as well as my streaming schedule!
YT: czcams.com/channels/SBbWhPHNiIs8VgLzW3s-Bg.html
Twitch: www.twitch.tv/tpotjj
@@tpotjj2979 awesome, keep up the good work bro
@@barnabaslada-hartyani8998 thanks for subscribing! Long way to go, just have to put in the work next couple of weeks.
Right on the money. No BS! No Hype! No extraneous info. Just get's to the point with clear graphics. 5 minutes and done. Beautifull!
Very informative videos from your channel. Thank you to you and your team who make so much effort with different tools and spend hours just for a short video. Another appreciable point is you read the comments on your videos and reply every question by viewers.
I love that these are "bite sized" at around 5m - I can always make a point of fitting them in even on a busy day, and they're always worthwhile :)
I ve been waiting for a channel like that for such a while thank u so much
This is amazing content. Thanks for making such high quality content available for free.
Segmentation and transcoding are key. I had always wondered how you'd deal with various resolutions and bitrates, and how you'd chop up a video in smaller pieces.
geez the explanation is superb! thanks! keep up the good work!
I love this channel. Last night I was literally asking: "I wonder what the architecture of a live streaming platform is" and BAM!
that is crazy considering he only have 18 videos in total
@@luv2stack RIGHT!?
is a quantum perfection no?
It's a gem! Thanks for sharing! :)
What software do you use to make these presentations? They're very slick!
Somebody get this guy a raise!
I am also curious what software is used to create those animations ?
Powerpoint
Thank you. Adobe illustrator and after effects
Besides the polished script, I gotta compliment the art design and pacing for these videos. 10/10
Wow that was a really smooth presentation on the topic
This is an Amazing Explaination Thank you for the video :D
This was a really good overview. thanks
Great Explanation. Thank you for the video!!!!
🎯 Key Takeaways for quick navigation:
00:07 📹 Live streaming faces challenges due to real-time internet transmission and compute-intensive video processing.
01:07 🌐 Encoders package video streams using protocols like RTMP, while newer options like SRT promise lower latency and network resilience.
02:06 🌍 Point-of-presence servers are used to optimize upload conditions for streamers and ensure fast transmission to the platform.
02:35 🔄 Adaptive bitrate streaming allows video players to adjust quality based on viewer's internet connection, and transcoding converts video streams into different resolutions.
03:38 📦 Popular live-streaming formats include HLS and DASH, with HLS being the most widely used format, consisting of manifest files and video chunks.
04:38 ⌛ Achieving lower latency may require sacrificing video quality, and some platforms offer options for streamers to adjust interactivity and quality.
Made with HARPA AI
Such great quality videos! ❤
Very nicely represented and done.
I loved the content. What do you use to edit the video? what do you use for the animations?
beautiful diagrams! 🕺 and great explanations
You make it so simple man!! thanks for share this knowledge
We are all learning how to make quality videos as we go. It takes a team. Our editors on illustration and animation are awesome, we have to say...
Thank you so much for such a great lesson/video. May I know what tool r u using for this graphic/video?
Thank you for such a high quality video
Great video as always
Please subscribe if you learned something new.! Thank you.
Tools we use: Adobe after effects and illustrator
Saas for managing company workflows would be great!
Thanks for this video. How do we implement the feature of playing video watched on one device to start exactly where we left on another like CZcams? Especially where and how do we store that data?
Great content, keep it up!
Very useful. Thank you
Very good! Thank you
Fantastic channel.
I would be interested in how to design an IoT telemetry system. It would be an interesting opportunity to explore time series databases.
That's a good idea. We will definitely do that at some point.
@@ByteByteGo Great ! Looking forward to it !
thanks for sharing, very informative. 🙂
Awesome video 👌🏻
very interesting. thanks for this good explanation
Appreciated your content, I couldn't stop your video once started to watch it. But please try making a more details Video, explaining more about the components. Thanks.
awesome! thanks!
much helpful videos content as a computer science student... keep going ❤❤👍👍👏
Thanks for great content !
Does anyone know, which software/tool is being used to make these videos/animation ?
We have some talented editors for illustration and animation, with the help of tools like Adobe After Effects, Adobe Illustrator.
thank you brother.
Thanks
What tool do you use to create such excellent animations?
Nice one !
Great video
Would you please make a video about how Jenkins works?
Which platform did he use to design this flow?
How can I do my podcast live? While using 2-3 different cameras & audio through a rodecaster pro?
May I ask what tool you use to create the schematics and stuff in your videos?
We have some talented editors for illustration and animation, with the help of tools like Adobe After Effects, Adobe Illustrator.
What technology did you used to build the presentation?
Interesting can you please tell me which tool you are making interesting diagram
Precisely and simple speaking. I have spend a few minutes everyday to watch. Can I ask what is your tool yo create such pretty presentation?
Thank you. Adobe illustrator and after effect.
@@ByteByteGo With the amount of people asking what you you use to make these animations (myself included), there might be a market out there tailored to system diagrams animations for those without graphics design background. I know I would pay for such a service.
Amazing!
Hey Alex
What are you using for creating these slideshows??
Looks amazing!
It takes a team. We have some talented editors for illustration and animation, with the help of tools like Adobe After Effects, Adobe Illustrator, etc. Each video takes many hours to make.
@@ByteByteGo ohh that’s crazy :)
Any tool suggestions for creating a nice presentation similar to what you do?
I wanna do something for my job, but don’t wanna go to crazy with video editors :)
How does the CDN delivers the content so fast to clients all over the world? That's the question I had in mind, but was not answered unfortunately. The rest of the process is interesting also, but I would have imagined something like that.
How the CDN achieves such latency all over the world is a mystery to me
4:20 he used the word "streaming format" for DASH/HLS which confused me. If I'm correct, it should be a "streaming protocol".
Could you do a presentation on how CDN works.
Thank you for the suggestion. We will put it on the list.
Is there a particular area of CDN you would want to know about?
@@ByteByteGo I want to know
1. How is the closest CDN server chosen by the client
2. Caching strategy in a CDN
3. How to stop unauthorised users from accessing secure content
How can i create my own sdk
This is very interesting… is this also similar to how a non live normal video share platform works..eg netflix prime youtube..?
It is similar. The main difference is that there isn't the same latency constraint so more time can be spent during the video processing stage to improve compression/quality and it's likely that a a different protocol is used on the ingestion side.
Can you please make a detailed video on GraphQL too🙏🏻🙏🏻🙏🏻
Yes, it is on our list.
@@ByteByteGo Thankyou so much for the update and also for the quality videos you make🙏🏻🙏🏻🙏🏻
hey, I am super sleepy, could you please write the document more easier to understand and remember, including all the details for interview. thank you
I'm presently at a loss on a project that involves live streaming i inherited. It was designed with ffmpeg as the transcoding engine and I'm having a huge problem with latency as its output is in rtmp.
Can you help me out with figuring out how to reduce latency for Live streams?
What is the latency now, and how low do you need to go?
@@ByteByteGo there's a massive delay of 11-18secs delay and i am looking at how to get it to 5-7 secs at the very least
So currently most of the stream services serves the content using tcp?
For live streaming, we believe the answer is yes. Both HLS and DASH are based on HTTP.
If and when they are updated to support HTTP/3, then we can probably say that they use UDP, since HTTP/3 uses QUIC and QUIC is built on UDP.
We have a video on HTTP/3 and QUIC: czcams.com/video/a-sBfyiXysI/video.html
Is SRT based on HTTP/3 ?
No, but both are UDP-based.
@@ByteByteGo Yes, this is why I asked.
Curious to know if there is some natural convergence between those two protocols.
Hey, do you have any clue why I can live stream on CZcams smoothly unlike Twitch where I get tons of frames drops. Never happened to me before and this issue just popped out of the blue. Twitch is my main platform..
Isn't it simpler to write a custom gRPC protocol that uses HTTP2?
I think its latency is much much lower than RTMP and SRT.
(The project I'm working on has a max streaming audience of 50 viewers. So my load balancing strategy is more relaxed. But thanks for the great video!)
Not sure if it is simpler. It sounds like a lot of work. 😂
Here's another angle. Many streamers prefer to use their own favorite encoder, with OBS being a prime example. Having our own custom protocol would limit that.
How do you animate your videos? 😱
Using Adobe After Effects for sure.
@@ibrahimkhurshid4339 Maybe! Some people script their videos, like 3b1b. But I assume that's inefficient for this kind of content
With video processing!
I would love to know this as well. Visualisation and animations in this video are amazing.
@@ibrahimkhurshid4339 is those effects available from the box there or you need to buy/animate by youeself all that fancy appearing icons?
Is Live-streaming same as video calling? If not what's the difference?
Could be, but it has some potential simplifications. For example:
In some scenarios (1:1), the quality may be requested by the client and the server-side transcoding can be omitted (almost) entirely. In most cases the number of necessary quality formats is lower and can be adjusted on the fly.
Video calling also does not benefit from any CDN caching and can skip this step entirely.
Basically: Video calling is just video streaming, but with a few potential optimisations due to the lower number of viewers.
Great question.
Live streaming and video conferencing/calling implementations are quite different. Video conferencing could be an interesting video.
The main difference is scale. Living streaming is 1-to-many, where the many could be in the millions. Video conferencing maxes out in the low hundreds, and the experience at that scale is not very good.
Also, video conferencing is bi-directional. That imposes a different set of design constraints.
To learn more about video conferencing, start with terms like WebRTC, SFU, and MCU.
@@ByteByteGo Thank you! I am learning how WebRTC works. Yes, it would be great if you make video or blog about video conferencing.
is this covered in book?
No, not in our two books.
it don't get better then this.
👏👏👏
Alex Xu老师 这个视频的齿音太明显了 需要升级下设备或者后期用专业软件消除下齿音 加油！
damn I don't see that in the book, why so many new items
This is why you experience slightly slow internet when you're on VPN
Teriffic video. CZcams is just flooded with filler content, so refreshing to see this type of material.
This could have been a nice video but you were too fast. Slow down a little
bro the video animation is very good, hats off. but the voice and explaination is soo poor..please hire a voice artist
I respectfully disagree. Even as a North American native English speaker, Sahn’s narration is one of the main reasons why I love this content. If the channel used a fully-polished professional narrator, I would probably stop watching. Other professionally-narrated “talk over” explainer videos make me lose focus very quickly. Sahn’s accent is unique and casual, and yet also simple and clear. Even though he is reading from a script, it’s not annoying or bland. Instead, it comes across as “even” and “steady”, which is exactly what you want for this type of content. This is a very difficult balance to pull off. I also appreciate his “talking head” in the corner, as it gives the viewer another location to “rest” their eyes from the topic being animated. Again, simple without being distracting. As a leaner, I don’t want to be smothered by professionalism; I want to remain engaged in the topic, which I think the team achieves very well.
Great video as always