- 112
- 130 425
dataEnthusiast
United Kingdom
Registrace 21. 10. 2014
On this channel, I will be focusing on making video about the Data Engineering tools I use.
Please do subscribe if you have any interest. Also, try and leave some comments and likes.
Please do subscribe if you have any interest. Also, try and leave some comments and likes.
Configure Kafka Connectors to Stream Data from Source to Azure Data Lake | Confluent | Azure
This video show end to end stream of data from source to data lake using Kafka connect.
zhlédnutí: 138
Video
How I Prepare and Pass the DP-203 Azure Data Engineer Associate Exam | Microsoft Certified Exam
zhlédnutí 169Před 2 měsíci
This video explains how and prepare for the Microsoft Certified: Azure Data Engineer Associate exam.
Accessing GitHub On Windows Using SSH Key | Adding New SSH Key to GitHub | SSH to GitHub
zhlédnutí 76Před 2 měsíci
This video shows how to generate new ssh key and add it to Github.
How to Write Subtraction, Factorial, and Fibonacci Functions in SQL | PL/PGSQL | PostgreSQL
zhlédnutí 124Před 2 měsíci
This video shows how to write both simple and complex function in PostgreSQL using PL/PGSQL.
Data Ingestion from On-Premises SQL Server to Azure Data Lake Explained | ADLS | ADF | Databricks
zhlédnutí 482Před 5 měsíci
This is a presentation covering data ingestion from on-premise SQL Server to Azure Data Lake Gen 2 storage. Steps: - Create Self-hosted IR on ADF - Install Self-hosted IR on on-premise machine - create copy activity as well as Linked Service connection to SQL server (source) - In the same copy activity, create Linked Service connection to ADLS storage - Additionally, you can decide to transform...
Coding with Code Wars: First non-repeating character | Python | Scala | Java
zhlédnutí 26Před 5 měsíci
Code Wars has variety of programming languages that you can practice with. There are a lot of questions you can solve. Link: www.codewars.com/dashboard
Difference Between FlatMap and Map | Scala | flatMap | map
zhlédnutí 69Před 5 měsíci
In this video, you will see how flatMap is differentiated from map. Using list of integers, list of list of integers, and list of strings, this video thoroughly explains the use case of both map and flatMap.
Comparing Scala and Python Code using Recursion | foldLeft | Reduce
zhlédnutí 59Před 6 měsíci
This video shows the difference between Scala and Python code implementation of tail recursion, foldLeft and reduce.
Pyspark Setup With Jupyter Notebook Integration On Windows | Spark | Anaconda | Python
zhlédnutí 680Před 8 měsíci
Pyspark or Spark Setup on Windows and Integration with Airflow are demonstrated in this video. Watch each step and you will get it done in no time. Java 8 Download (Oracle): www.oracle.com/uk/java/technologies/javase/javase8u211-later-archive-downloads.html You may have to create an account and login to Oracle in order to download the JDK. Hadoop winutils Download: github.com/cdarlint/winutils
How to Perform Full Join in Spark | Full Outer Join | Spark Join
zhlédnutí 75Před 8 měsíci
The Full Join type is also called Full Outer Join. This video demonstrates how to join two tables using full join type
Right Outer Join In Spark | Apache Spark | #bigdata
zhlédnutí 43Před 8 měsíci
Righter Outer Join or Right Join returns all the records in the right table and all the matching records in the left table. Any records in the left table that are not matching will be populated with null in the returned table.
How to Use Left Anti Join in Spark | #apachespark
zhlédnutí 74Před 8 měsíci
Left Anti Join is the opposite of Left Semi Join. This video demonstrates the difference between both join types.
Understand How to Use Left Semi Join in Apache Spark Easily
zhlédnutí 24Před 8 měsíci
This is a quick video that demonstrates how left semi join can be used in Spark
Understanding and Working with Spark Web UI | Local Check Point | Scheduler | Max Partition Bytes
zhlédnutí 222Před 9 měsíci
In this video, I talk about localCheckPoint, FIFO and FAIR Spark Scheduling Modes, and maxPartitionBytes.
Understanding and Working with Spark Web UI | Persist | Repartition
zhlédnutí 359Před 9 měsíci
Understanding and Working with Spark Web UI | Persist | Repartition
Understanding and Working with Spark Web UI Beginners
zhlédnutí 304Před 9 měsíci
Understanding and Working with Spark Web UI Beginners
How to apply Coalesce Function on Dataframe Columns in Spark
zhlédnutí 105Před 10 měsíci
How to apply Coalesce Function on Dataframe Columns in Spark
How to Setup settings.xml for Intellij and Maven Project | Intellij | Maven
zhlédnutí 5KPřed 11 měsíci
How to Setup settings.xml for Intellij and Maven Project | Intellij | Maven
Creating AWS Global Accelerator for EC2 Instances in Three Regions | Tokyo | California | London
zhlédnutí 193Před rokem
Creating AWS Global Accelerator for EC2 Instances in Three Regions | Tokyo | California | London
What is AWS S3 Presigned URL and How to Generate it | S3 Bucket | AWS
zhlédnutí 37Před rokem
What is AWS S3 Presigned URL and How to Generate it | S3 Bucket | AWS
How to Delete CloudFront CDN and S3 Bucket
zhlédnutí 391Před rokem
How to Delete CloudFront CDN and S3 Bucket
How to Create CloudFront for a S3 Bucket | CDN | OAC
zhlédnutí 3,5KPřed rokem
How to Create CloudFront for a S3 Bucket | CDN | OAC
How to Create and Test Application Load Balancer for EC2 Instance in AWS
zhlédnutí 229Před rokem
How to Create and Test Application Load Balancer for EC2 Instance in AWS
How to SSH into EC2 Instance Using Windows - PUTTY and SSH
zhlédnutí 181Před rokem
How to SSH into EC2 Instance Using Windows - PUTTY and SSH
How to Create and Launch EC2 Instance in AWS
zhlédnutí 85Před rokem
How to Create and Launch EC2 Instance in AWS
How to Send Spark Application Log Into a Log File Using Log4j
zhlédnutí 1,8KPřed rokem
How to Send Spark Application Log Into a Log File Using Log4j
Execution Timeout in Airflow | Airflow Task Timeout
zhlédnutí 1,2KPřed rokem
Execution Timeout in Airflow | Airflow Task Timeout
For all those who are getting error after 24:10 do conda uninstall python and then conda install python=3.11.8. Do Like:)
bro, I cannot create cloudfront distribution in my new AWS account .. whats the possible solution ?
@@lennoxx-n9qI'm not sure what could be the issue but try creating it in a different region as part of debugging process. Maybe it will work.
Thankyou so much you solved my big problem ❤
@@aaishwaryawankhede7354 Glad it helped you
I am still getting and error after updating PYSPARK_PYTHON environment varaibale at 24:10. Error is "Python worker exited unexpectedly (crashed)" Can you please help.
Thanks dude, saved my life
Thank You
You're welcome
pain in motherfucking ass to set up this stupid thing
could you please pass me the source
Thank you for this, you're a lifesaver. 😊
Glad I could help
Thanks bro❤❤
Legend!!
Glad I could help.
Thank you so much man. Very straight forward and well explanatory.
THANK U THANK U THANK U!!!!
Glad I could help.
You solved my problem.. thanks mate :)
Can you share the github repo ?
Unfortunately, I did not push the code to GitHub
Brilliant. Your video saved me! My IT Helpdesk couldn't help, me but you could.
Happy to hear that
i still get the error at minute 19:30 even after setting the Python variable, what can it be?
Try to check your python path using the the following script. Make sure it's pointing to anaconda3. import os python_path = os.path.sys.executable print(python_path)
@@dataenthusiast6721 works fine now,Thanks!
Thank you
what if we want to include some third party libraries inside the jar file？obviously, sbt package command will not add those and build a fat jar for you
Try and use sbt-assembly or sbt-onejar plugin. Also, you can create a library file and put those dependencies there.
no files found in ICA Client file as shown. what should do now ?
You can try and uninstall and reinstall Citrix
Thanks for the great, clear tutorial.
Great work, man. So useful and complete, thank you so much.
Can you do a video implementing KMS CMK into the S3 bucket?
Perfect 👍👍
thank you so so much, i've been stucked with this problem for hours and your help make it real quick, appreciate your work!
Glad I could help. Thanks for the appreciation
thanks very much. you saved my life
worked! I had to reinstall (download the same CitrixWorkspaceApp.exe version as I had on my computer and install; no uninstallation of what I already had needed) and then the previously-missing very-coveted wfcrun32 magically reappeared! then I was able to "Open With" wfcrun32 as you noted. keep it up, dataEnthusiast!!
thank you so much !
Thank you so much, you saved my a**!!!!!
Thank you so much! This finally solved my problem!
Glad it solved it
OH MY GOD, this actually worked. Thank you.
Glad I could help
OMG Thank you so much. I was so stressed when i couldn't open my work program!!! You saved my life
Glad I could help
Thank you, very well-done.
Thank you so so so much!! I have finally solved my problem!!
Thankyou. It's working fine for me
Was forced to use a new work laptop and my citrix software didn't transfer over from my old one. Thanks to this video, I was able to figure out what to open my .ica files with when I re-downloaded the software. Thanks!
Glad it helps
Fucking legends man... Hit a god damn brick with this for awhile, came in clutch!!! Video is still a solution till this day for anyone wondering
I'm glad it helps
great job , clear and useful.
Thank you, I am having a hard time with setting up Scala and Maven and scrambling through your videos to get help, saw that you had no one comments so decided to leave one. Thank you for your work!
Glad you find it helpful
how to do in eclipse
I don't think it should be any different. You can use scalatest instead of Junit.
I Can't thank you enough Mannnnnn. My work is based on Citrix and I could've banged my head against wall. Thank you for saving me 😢❤
Glad it resolved your issue.
Great work. Up to date and accurate. I hope the channel grows well for you.
Much appreciated!
nice
First Like
Appreciate it
You are awesome, you saved me from the days of troubleshooting
Glad it resolved the issue
Obrigado. Já não sabia como proceder aqui. Thanks!!!
I FUCKING LOVE YOU MANNNNNN!!!!!!! THANKS BROTHER YOU SAVED MY LIFEEEEEEEEEEE!!!!!!!!
Glad you find it useful
Absolute legend mate!
Glad I could help
thx bro
What if you want to convert all the rows to lower case?
You can use spark lower() and upper() functions to convert records casing