Top Data Engineering Skills To Learn In 2022
Vložit
- čas přidán 26. 07. 2024
- Data engineering is a fast-growing field in the data analysis industry, which is why so many professionals are on the hunt for new data engineering tools to learn in 2022.
Data engineering is also considered to be a subset of the broader field of data science. Data engineers are experts in data analytics and data warehousing, and they specialize in collecting, storing, and analyzing data.
Data engineering requires dealing with huge volumes of data, and it is a highly specialized field. It is not just data collection, data access, data processing, and data storage that data engineers deal with.
They also handle the whole process of data management, data governance, and data quality, in addition to data analytics.
Data engineering is an ever-evolving field, and it will be even more important in the future, as the amount of data being generated grows every day.
Sources Mentioned in the video -
1. www.udemy.com/course/the-comp...
2. • Apache Airflow: The Ex...
3. cloud.google.com/bigquery
4. www.snowflake.com/
5. / dbt-a-new-way-to-handl...
6. docs.getdbt.com/docs/introduc...
TIMESTAMP
0:00 Introduction
0:27 Tool Number 1
2:15 Tool Number 2
4:07 Tool Number 3
5:24 Tool Number 4
6:14 Tool Number 5 (Don't Skip)
Join this channel to get access to perks:
/ @darshilparmar
===================Follow Me Here===================
👦🏻 My Linkedin - / darshil-parmar
📷 Instagram - / darshilparmarr
🎯Twitter - / parmardarshil07
===================About Me===================
Freelance Data Engineer and Solution Architect.
I love learning about technology and teaching thing I know to other people. The goal of creating this channel was to teach everything I know to the world, I have spent most of my time learning things online and I want to share all my learning on this youtube channel.
I will be posting content related to data engineering, architecting systems, data science, machine learning, and interview preparation.
Thank you for watching the video, see you in the next video :)
My Accessories
🎙 Mic -amzn.to/3Bnu53n
📱 Camera (I use my phone) - amzn.to/3wOogIU
🎧 Headphone - amzn.to/3BsJxLB
⌨ Mouse and Keyboard - amzn.to/3zeF1yq
🖥 Monitor - amzn.to/3zk0Dts
#dataengineering #datascience #aws
Helpful. Thank you Darshil
Crisp, to the point and really informative. Would like to watch more videos like these.
Thanks, will do!
Another great video!!
Thank you
Great video, so what is the first step you would or any data engineer would do when he gets the data from stakeholders or anywhere else?
thank you so much for such a precious content
Thank you for always watching and supporting my work
Good info bro!
Thank you bro
saras saras bhai
Thank you
Sir this is a fantastic video. Great job. super informative and helping me on my journey.
I am glad you found this helpful, all the best with your journey
Hi nice video, can you also share your thoughts on learning spark (pyspark) and Kafka
Yes I’ll add it in my list
As a ETL Testing perspective do I need to more proficient in python also?? As i'm more inclined towards SQL
Yes one programming language is fine
I think you can go with Python. Even python can be used for automating many manual testing activities in ETL testing
Thanks for the video its really helpful. Can you please give me an advice that I'm new in Data stuff. I'm too confuse that either I should go directly for Data engineering or learn/overview whole data science cycle including machine learning and after that I should learn Data engineering. Please tell me is it worth spending time into data science first.
First please have a look on these videos
czcams.com/video/yQvuiqUNPVY/video.html
czcams.com/video/NToi35FSSnA/video.html
Then decide what you want to become
Thanks for sharing information.
Could you please do one project on data engineer ( complete start to end) it's my request
Hey,
I have different project series on my channel
check here
studio.czcams.com/channels/ChmJrVa8kDg05JfCmxpLRw.htmlplaylists
Hi informative video, one thing I want to ask you bro currently I have 1.5 years experience as an ETL developer working on sql query so if now i want to apply for Data Engineer role will my previous experience be considered?
Yes, any experience related to data warehousing, any ETL tool, SQL is a valid experience to be become a data engineer.
You can learn big data to improve you profile
@@amolkale1158 Okay.. Thanks Sir
Can u please make video on data scientist skills and mainly who can become and how to become a data scientist as a fresher in this industry it will be of so much help 🙏
Watch these two videos -
1. czcams.com/video/kU58_NaEjCk/video.html
2. czcams.com/video/fzyv5wxAeG8/video.html
Can you please make video on how to study Data pipeline system design?
Sure will add it in my list
Thanks for sharing your knowledge 😃
My pleasure!
Data engineer's number one tool is Google search 😂
True 🤣🤣
Sir which social media handle are u most active on beside CZcams?
Twitter and Instagram
@@DarshilParmar sir can u make a video on getting remote jobs for data analyst, how to build profile for it, networking through twitter and linkedin, making projects for it etc
@@DarshilParmar like ishan sharma and Kunal kushwaha interview
@@DarshilParmar czcams.com/video/dVoq5vjNI1Y/video.html
Hey bro i need ur suggestion
I'm a complete fresher from non cs background. I taken a course on data engineering n it'll get over soon. So how do I get into the industry i don't think company will hire freshers as data engineer can u suggest me a roadmap please
I have different videos on this topic
1. czcams.com/video/cwvYQEptP9A/video.html
2. czcams.com/video/BJKCQ9ld-Ac/video.html
3. czcams.com/video/lQ9AtozWGrg/video.html
Is learning spark is not much important in 2022 to become data engineer
It is but as I said I can’t cover everything in single video so you can put suggestions in comments :)
@@DarshilParmar thanks
Please can you make a video on how to improve communication for someone who is very introvert
Sure, will add it in my list
@@DarshilParmar Thank you😇
Good vid but transition sounds are too loud
Sorry for that, I’ll make sure they are lower from next videos
bro i have one doubt ,u are earning 6 digit figure but aging why your background ,lighting ,camera used by you ...all are very low quality...can plz tell me ..why didn't you upgrade your room ...