04 Spark Streaming Read from Sockets | Convert Batch Code to Streaming Code

Video covers - How to write Streaming Application? How to convert Batch code to Streaming code ? How to read streaming data from Sockets?
Chapters:
00:00 - Introduction
00:22 - What are Sockets?
00:48 - Install ncat
02:35 - Word Count Problem Solution
03:16 - Batch Version of Program
08:09 - Streaming Version of Program
URLs:
Github Code - github.com/subhamkharwal/spar...
Keywords: Apache Spark, PySpark, Spark Streaming, Real-time Data Processing, Data Streaming, Big Data Analytics, PySpark Tutorial, Apache Spark Tutorial, Streaming Analytics, Spark Structured Streaming, PySpark Streaming, Big Data Processing.
New video in every 3 days ❤️
Make sure to like and Subscribe.

[@Bijuthtt]

Awesome. Super explanation . I love it

[@easewithdata]

Thanks, Please share with your Network over LinkedIn ❤️

[@babuganesh2000]

❤❤❤❤❤❤❤
You are doing great work no words to thank you

[@souvik5560]

Simple and crisp .
Thank you so much for the initiative 🙏

[@easewithdata]

My pleasure 😊

[@sypoo2120]

it is awesome. thank you

[@easewithdata]

Thanks, please make sure to share with your network.

[@mohdkhalidsiddiqui5317]

Great work

[@easewithdata]

Thank you so much 😀

[@prathamesh_a_k]

nice explaination bro, keep it up

[@easewithdata]

Thanks 🙂

[@irenebinoy4002]

Great explanations & effort taken. I have encountered an Py4JJavaError while executing the df_agg.writeStream.format("console").outputMode("complete").start().awaitTermination command.Could you explain why?

[@easewithdata]

please check the logs to debug the issue.

[@user-sq7si4jz5h]

❤❤

[@vipulsarode2722]

Hello, what if I wanted to do this in VSCode instead of Jupyter Notebook with docker as shown in the video?

[@easewithdata]

You can write the complete code in scripts using vs code and then trigger them using spark submit command

[@LuisRamirez-jv2jc]

What would you do in production instead of sockets?

[@easewithdata]

Just use a proper data source (files, kafka, kinesis, queues etc) simple. Majorly scokets are used to test applications.

[@MoneyMatter9]

Sir please Hindi bhi use kar lia kare aap please 🥺 sir

[@easewithdata]

😄😄
Isse jada easy english to main use bhi nhi kar sakta. Next time try karunga 😉