Streaming from Kafka Source

Spark Programming and Azure Databricks ILT Master Class by Prashant Kumar Pandey - Fill out the google form for Course inquiry.
forms.gle/Nxk8dQUPq4o4XsA47
-------------------------------------------------------------------
Data Engineering using is one of the highest-paid jobs of today.
It is going to remain in the top IT skills forever.
Are you in database development, data warehousing, ETL tools, data analysis, SQL, PL/QL development?
I have a well-crafted success path for you.
I will help you get prepared for the data engineer and solution architect role depending on your profile and experience.
We created a course that takes you deep into core data engineering technology and masters it.
If you are a working professional:
1. Aspiring to become a data engineer.
2. Change your career to data engineering.
3. Grow your data engineering career.
4. Get Databricks Spark Certification.
5. Crack the Spark Data Engineering interviews.
ScholarNest is offering a one-stop integrated Learning Path.
The course is open for registration.
The course delivers an example-driven approach and project-based learning.
You will be practicing the skills using MCQ, Coding Exercises, and Capstone Projects.
The course comes with the following integrated services.
1. Technical support and Doubt Clarification
2. Live Project Discussion
3. Resume Building
4. Interview Preparation
5. Mock Interviews
Course Duration: 6 Months
Course Prerequisite: Programming and SQL Knowledge
Target Audience: Working Professionals
Batch start: Registration Started
Fill out the below form for more details and course inquiries.
forms.gle/Nxk8dQUPq4o4XsA47
--------------------------------------------------------------------------
Learn more at www.scholarnest.com/
Best place to learn Data engineering, Bigdata, Apache Spark, Databricks, Apache Kafka, Confluent Cloud, AWS Cloud Computing, Azure Cloud, Google Cloud - Self-paced, Instructor-led, Certification courses, and practice tests.
========================================================
SPARK COURSES
-----------------------------
www.scholarnest.com/courses/s...
www.scholarnest.com/courses/s...
www.scholarnest.com/courses/s...
www.scholarnest.com/courses/s...
www.scholarnest.com/courses/d...
KAFKA COURSES
--------------------------------
www.scholarnest.com/courses/a...
www.scholarnest.com/courses/k...
www.scholarnest.com/courses/s...
AWS CLOUD
------------------------
www.scholarnest.com/courses/a...
www.scholarnest.com/courses/a...
PYTHON
------------------
www.scholarnest.com/courses/p...
========================================
We are also available on the Udemy Platform
Check out the below link for our Courses on Udemy
www.learningjournal.guru/cour...
=======================================
You can also find us on Oreilly Learning
www.oreilly.com/library/view/...
www.oreilly.com/videos/apache...
www.oreilly.com/videos/kafka-...
www.oreilly.com/videos/spark-...
www.oreilly.com/videos/spark-...
www.oreilly.com/videos/apache...
www.oreilly.com/videos/real-t...
www.oreilly.com/videos/real-t...
=========================================
Follow us on Social Media
/ scholarnest
/ scholarnesttechnologies
/ scholarnest
/ scholarnest
github.com/ScholarNest
github.com/learningJournal/
========================================

[@zakariaelaaliji7747]

please what are the versions you installed for kafka and spark ?

[@crimemastergogo5283]

How are you able to run .cmd files directly from the IDE? I have installed "CMD support" plugin and I am still not able to run the .cmd files. Kindly advise.

[@Bryan-zj7nr]

I'm using MacOS, how to setup all this ??

[@HIMANSHUMISHRA-yg8dc]

ModuleNotFoundError: No module named 'pyspark.streaming.kafka' error
using command spark-submit --packages org.apache.spark:spark-streaming-kafka-0-10_2.13:3.5.1 live_processing.py can you help please?

[@cinciclubbers]

Hello, sir! I purchased your Kafka master class on Udemy. I have a question as to whether or not Java 8 will still be relevant in the future of Kafka and even Spark. I am learning Spark with Java currently as well. I am using J8 lambdas. Thank you for your time.

[@shivkj1697]

Could you also share the source code for pos-simulator-2.0.0.jar, I am getting some problem running it

[@ScholarNest]

What problem are you getting? Unfortunately, I cannot find the source code for the Jar. I missed to check-in that in GitHub.

[@prayagkr]

I am trying to use spark.jars.packages in spark-default.conf. Its not working for me. I am using Linux Mint (Ubuntu) . I added it
SparkSession.builder.config(" spark.jars.packages", "org.apache.spark:spark-sql-kafka-0-10_2.12:3.0.1") and its working. What should i do to make it work from spark-default.conf

[@ScholarNest]

What are you using? Pyspark? Make sure you have the spark home environment variable set.

[@crimemastergogo5283]

Could be a newbie reply but did you remove the .template extension from the configuration file?