AWS Serverless Lambda Supports Response Streaming

Lambda now supports Response payload streaming, now you can flush changes to the network socket as soon as it is available and it will be written to the client socket. I think this is a game changing feature
0:00 Intro
1:00 Traditional Lambda
3:00 Server Sent Events & Chunk-Encoding
5:00 What happens to clients?
6:00 Supported Regions
7:00 My thoughts
aws.amazon.com/blogs/compute/...
Fundamentals of Backend Engineering Design patterns udemy course (link redirects to udemy with coupon)
backend.husseinnasser.com
Fundamentals of Networking for Effective Backends udemy course (link redirects to udemy with coupon)
network.husseinnasser.com
Fundamentals of Database Engineering udemy course (link redirects to udemy with coupon)
database.husseinnasser.com
Follow me on Medium
/ membership
Introduction to NGINX (link redirects to udemy with coupon)
nginx.husseinnasser.com
Python on the Backend (link redirects to udemy with coupon)
python.husseinnasser.com
Become a Member on CZcams
/ @hnasr
Buy me a coffee if you liked this
www.buymeacoffee.com/hnasr
Arabic Software Engineering Channel
/ @husseinnasser
🔥 Members Only Content
• Members-only videos
🏭 Backend Engineering Videos in Order
backend.husseinnasser.com
💾 Database Engineering Videos
• Database Engineering
🎙️Listen to the Backend Engineering Podcast
husseinnasser.com/podcast
Gears and tools used on the Channel (affiliates)
🖼️ Slides and Thumbnail Design
Canva
partner.canva.com/c/2766475/6...
Stay Awesome,
Hussein

[@MaulikParmar210]

This announcement is because the base project that powers lambda called "Amazon Firecracker" released 1.3.0 on march 2 which added this line in releases.
"Improved TCP throughput by between 5% and 15% (depending on CPU) by using
scatter-gather I/O in the net device's TX path."
Essentially, it allows the sheer scale of the platform to take that extra TCP overhead and remove restrictions without waiting for application to write to buffer and pass it down, instead it can pass small chunks and OS will take care of stitching written data.

[@coekush]

Thanks for the quick intro to the new AWS Lambda response streaming feature. Your content was insightful and easy to understand. Appreciate it!

[@22Kyu]

Interesting, would like to see these in action soon, to test out the limits and constraints of this feature..

[@2penry2]

This is pretty cool, can actually self host next13 server components now! Did you see vercel's write up on how that were mocking streaming responses? Pretty interesting stuff

[@hirisraharjo]

can you share the link about that write up?

[@ChristianProetti]

Cloudflare Workers has had this for like 3 years.

[@FauzulChowdhury]

I did host pages before in serverless and works fine. Yes it had cold start issues but hey, it worked great for dev / qa environments without costing almost anything.

[@skyhappy]

Are these static pages? Why not use netlify or github pages then

[@ctmithun8916]

Are there any updates from AWS on expanding this feature to other programming languages?

[@pritomb]

I think this feature will be helpful for delivering the API responses which are very long and need a lot of time to calculate. So, if it can stream the list of data sequentially as a stream of data, then the frontend app can start populating the data and Don't have to wait for the entire batch processing. I am not sure I haven't read the feature docs yet. If this is the case then it's really a game changer I think. But I have to read the docs in detail.

[@adambickford8720]

Most clients are going to buffer it into a well formed JSON payload anyway

[@catcatcatcatcatcatcatcatcatca]

Doesn’t removing the return size cap open a lot more doors than just better responsiveness? Cost is the only cap on how long and complex you want your return to be. If you wanted to create an application that returns an animation that zooms into the mandelbros set diagram, or any other endless task, can’t you now do any such task?
In one sense it makes a lot of sense if you can. AWS would obviously prefer you to use their service as much as possible. Most likely any such application would in practice be better done with some other amazon service.
But it still would be a very fundamental change, allowing not just tasks dependant on response time and much longer tasks that would have been limited not by response time but by the cap on data returned.

[@user-iv3xf7zn9u]

is this only support for Nodejs applications?

[@shahriajamankhan1760]

Please make a video on Firebase (backend as a service).

[@mikestaub]

This is the biggest feature since they accounted lamba.

[@joelamoako6778]

I think you should start a podcast on apple podcasts

[@ZeeshanAli-nk3xk]

jazakAllah u khair for the video. How is your Ramadan going on?

[@e.b.7485]

Can you make a Video on GPT? I just cant stop being sad.

[@DireRavenGG]

first

[@classical-bit]