Data Engineer Complete Roadmap For Beginners and Experienced Professionals (2024) | ft. @azureli

Sdílet
Vložit
  • čas přidán 23. 07. 2024
  • In this video i will be talking to Deepak Goyal and discuss about what it takes to become a data engineer. What are prerequisite and advanced technologies that they need to learn.
    We will also talk about how working professional from other data background can move to data engineering. Please like and share this video as much as possible.
    Zero to hero(Advance) SQL Aggregation:
    • All About SQL Aggregat...
    Most Asked Join Based Interview Question:
    • Most Asked SQL JOIN ba...
    Solving 4 Trick SQL problems:
    • Solving 4 Tricky SQL P...
    Data Analyst Spotify Case Study:
    • Data Analyst Spotify C...
    Top 10 SQL interview Questions:
    • Top 10 SQL interview Q...
    Interview Question based on FULL OUTER JOIN:
    • SQL Interview Question...
    Playlist to master SQL :
    • Complex SQL Questions ...
    Rank, Dense_Rank and Row_Number:
    • RANK, DENSE_RANK, ROW_...
    #sql #dataengineer

Komentáře • 75

  • @durgaprasad-vm4mh
    @durgaprasad-vm4mh Před 10 měsíci +40

    Road map: SQL, python, azure, adf, pyspark, Databricks. Entire 27 minutes summary. Even after 6 months roadmap will be same.

  • @mohitmotwani9256
    @mohitmotwani9256 Před 10 měsíci +1

    Great one! Thanks.

  • @aishwaryac3845
    @aishwaryac3845 Před 7 měsíci

    Thanks Ammitji for the roadmap.the best on internet.

  • @bukunmiadebanjo9684
    @bukunmiadebanjo9684 Před 10 měsíci

    Great content Ankit 👍

  • @dataquery03382
    @dataquery03382 Před 10 měsíci +1

    Great session sir

  • @ajithshetty1684
    @ajithshetty1684 Před 10 měsíci +1

    Need of the hour, Thank you so much Ankit for this wonderful session to data community 😊

  • @gunjankothari7471
    @gunjankothari7471 Před 9 měsíci

    Well explained..

  • @karthikeyana6490
    @karthikeyana6490 Před 10 měsíci +2

    Very cool! Thanks both😊

  • @ankitbansal6
    @ankitbansal6  Před 10 měsíci +3

    Hit the like button on the video if you want me to create more podcast with data expert in the field.
    Follow Deepak Goyal here : www.linkedin.com/in/deepak-goyal-93805a17
    My next live SQL zero to hero bootcamp for data analytics starting October 7th. Register your spot here for a magical experience:
    www.namastesql.com/courses/Think-SQL-Go-from-Zero-to-Hero-October-64f59039e4b00ea856fa045d

  • @AlbouryNdiaye-ro8qz
    @AlbouryNdiaye-ro8qz Před 9 měsíci

    Thank you so much both for your actionable insights. Really appreciated this conversation.

  • @anupgupta5781
    @anupgupta5781 Před 10 měsíci +2

    Glad to see both Guru together... You both are helping the data community in so many ways

  • @sapnanimbalkar1210
    @sapnanimbalkar1210 Před 10 měsíci +1

    Thank you Deepak and Ankit for valuable guidence on roadmap

  • @sammail96
    @sammail96 Před 10 měsíci +1

    Very nice podcast. Thank you Ankit

  • @tipsandhacksbygaurav
    @tipsandhacksbygaurav Před 10 měsíci +4

    One of the best podcast regarding this topic.
    One thing that you need to be covered in your next podcast, like if someone has 7+ yrs of experience in IT or programming background but not related to data focused role.
    What they will do for transition into a data engineer role from a non-data role (but they know programming stuff)

    • @ankitbansal6
      @ankitbansal6  Před 10 měsíci

      Sure

    • @ramuraman8426
      @ramuraman8426 Před měsícem

      That Deepak said we have to showcase something like whatever the project you have done convert it into Data Engineering style 😊

  • @joerokcz
    @joerokcz Před 10 měsíci +5

    When deepak said hadoop is obsolete, he tries to to mention Mapreduce is obsolete, hdfs and yarn are still on the market.

  • @kanchankumar3355
    @kanchankumar3355 Před 10 měsíci +1

    Great initiative Ankit bro 👍

  • @silverfang6486
    @silverfang6486 Před 9 měsíci

    Hi which course will you recomend to learn ? I'm an ETL Tester..have knowledge on SQL

  • @Kondaranjith3
    @Kondaranjith3 Před 10 měsíci +1

    Thank you 👍

  • @utkarshmishra5057
    @utkarshmishra5057 Před 10 měsíci +1

    I just recommend your yt playlist and Deepak’s course . Awesome information

  • @views-re2om
    @views-re2om Před 8 měsíci

    Hey I am working as an ux designer i want to move to Data engineering i know python and sql well, can i get succeed in this field? i have this fear companies dont hire from design field :(

  • @TechnoSparkBigData
    @TechnoSparkBigData Před 10 měsíci +3

    I have never seen a person like Deepak. He is very polite, humble, down to earth. We have very less people in this world like him. Thanks for being the motivation for the people and creating such a wonderful content both of you.

  • @venkateshchandru128
    @venkateshchandru128 Před 10 měsíci

    Thank you Ankit :)

  • @AdityaRaj-ti3uz
    @AdityaRaj-ti3uz Před 8 měsíci

    Hi Ankit
    I am working as consultant and want to move towards data engineering my current job is not from data domain so please make a video for transition towards data engineering

  • @Sanskritik_bharat
    @Sanskritik_bharat Před 10 měsíci +1

    Hi Ankit
    I am continously failing in interviews.I can solve SQL problem but in the intervies there is no hit and trial.We have to write correct query in one go. How to do it? please guide me.

    • @MachinoLearno
      @MachinoLearno Před 10 měsíci +1

      Repetition bro. Just solve as much problems as you can.

  • @user-su2wt6rb2v
    @user-su2wt6rb2v Před 10 měsíci +3

    Hi Ankit\Deepak,
    Being 11 years of oracle plsql developer , to crack data engineer interview not with respect to technology perspective because that's a long term approach in short terms what topics are most important so that other can be settled by SQL even if we dont have experience in data engineer.

    • @ankitbansal6
      @ankitbansal6  Před 10 měsíci +1

      SQL ,Python and a bit of cloud understanding

    • @user-su2wt6rb2v
      @user-su2wt6rb2v Před 10 měsíci

      @@ankitbansal6 will unix shell scripting works in place of python because both are scripting language

  • @djsahu98
    @djsahu98 Před 9 měsíci +1

    If I'm from different domain and want to switch to Data Engineering how I should make my resume and proceed. Please help I'm very disappointed of non getting shortlisted each and every time.

  • @drishtisahu7887
    @drishtisahu7887 Před měsícem

    my current job is not from data domain so please make a video for transition towards data engineering

  • @user-dk5rg8vt7t
    @user-dk5rg8vt7t Před 10 měsíci +2

    Bro... I had commerce in 12th , and I am little bit confused about data analyst and data engineer , bcz I am not from maths and stats background 😢 so could you please tell me how much maths is really required in this field? Help me bro 😢

    • @ankitbansal6
      @ankitbansal6  Před 10 měsíci

      Not much, very basic. For data analysts just SQL , excel and bi tool will do.

    • @user-dk5rg8vt7t
      @user-dk5rg8vt7t Před 10 měsíci

      @@ankitbansal6 for data engineer?

  • @09tt072
    @09tt072 Před 10 měsíci +2

    Ankit and Deepak , both are very honest guys

  • @amrindersingh4591
    @amrindersingh4591 Před 10 měsíci +2

    Ankit Bhai Zindabad

  • @user-jy8mt2om6g
    @user-jy8mt2om6g Před 9 měsíci +1

    Thank you sir,it was great, Sir pls clarify my doubt on rolling sum. IF WE WANT TO CALCULATE SUM OF 1 ROW BEFORE AND 1 ROW AFTER THE CURRENT ROW,SKIPPING THE CURRENT ROW, WHICH FUNCTION I HAVE TO USE SIR?
    Question is like this sir,"Show the username of each user along with the number of photos they have posted and the number of photos posted by the user before them and after them, based on the creation date." please help sir
    🙏

    • @ankitbansal6
      @ankitbansal6  Před 9 měsíci

      Use lead and lag and add

    • @user-jy8mt2om6g
      @user-jy8mt2om6g Před 9 měsíci

      @@ankitbansal6 yes sir, i used the same ( lead() + lag() ) for this the answer is returning 2 for every row, which is wrong sir. So i am confused to use which function

  • @ashanair5909
    @ashanair5909 Před měsícem

    Getting your first DE job is hard but once you have it, the next thing is to do well and grow in it.
    How to do it?

  • @parthasarathimandal9437
    @parthasarathimandal9437 Před 10 měsíci

    Is it possible to skip python and pyspark to become data engineer? Currently working as ETL Informatica developer and not much into coding before.

  • @aadil8409
    @aadil8409 Před 10 měsíci

    Good Podcast, but sir it's still 2023, just checked the calander to confirm 😄😄

    • @ankitbansal6
      @ankitbansal6  Před 10 měsíci

      I know. It's a future proof roadmap.

  • @Thekingslayer-ig5se
    @Thekingslayer-ig5se Před 10 měsíci +1

    Thank you so much sir

  • @germanaboytes649
    @germanaboytes649 Před 8 měsíci

    what about Linux is it important to learn it ?

  • @Dariusrae45636
    @Dariusrae45636 Před 7 měsíci

    Sir.... I am very interested but Data Engineering is gng to die in 5 years right??....many people are saying this..... please throw some light in this context sir😢

    • @ankitbansal6
      @ankitbansal6  Před 7 měsíci +1

      It's not going anywhere . You can go for it 😊

  • @vidulat6935
    @vidulat6935 Před 10 měsíci

    I have 11.5 years of experience I want to learn data engineering, please advice

    • @ankitbansal6
      @ankitbansal6  Před 10 měsíci +1

      Start with SQL and python. After that pick one cloud.

    • @chandu4649
      @chandu4649 Před 10 měsíci

      Sql server or my sql
      Which one best

  • @Rouui9
    @Rouui9 Před 8 dny

    Stopped watching when u say azu-Reee to Azure

  • @prem1.83
    @prem1.83 Před 9 měsíci +1

    From where we can learn spark in a better way?

  • @datalearningsihan
    @datalearningsihan Před 4 měsíci

    Learning SQL is not that easy, I have been using sql for last four years and I still feel like I know nothing. T-SQL DBA is vast.

  • @AbhishekKumar-gf4db
    @AbhishekKumar-gf4db Před 5 měsíci

    I am a database Developer,how to become Data Engineer