Essential Hadoop HDFS Commands Well Explained | Kundan Kumar |

Sdílet
Vložit
  • čas přidán 11. 06. 2024
  • In this video, we delve into the fundamental commands of Hadoop's HDFS (Hadoop Distributed File System) to help you manage and interact with your data efficiently. Whether you're a beginner or looking to sharpen your skills, this tutorial will guide you through the most important HDFS commands you'll need to know.
    What You'll Learn:
    1. Introduction to HDFS Commands: Understand the basics of HDFS and its role in the Hadoop ecosystem.
    2. Listing Files and Directories: Learn how to use the hdfs dfs -ls , hdfs dfs -lsr, hdfs dfs -ls -R command to list files and directories and directory tree.
    3. File Operations: Explore commands like hdfs dfs -put, hdfs dfs -get, and hdfs dfs -copyFromLocal to manage file transfers.
    4. Directory Operations: Discover how to create and delete directories using hdfs dfs -mkdir and hdfs dfs -rm -r.
    5. File System Checks: Understand how to check the health of your HDFS using hdfs fsck and other related commands.
    Thank you for watching, and let's embark on this journey to mastering Hadoop together!

Komentáře • 13

  • @chris-cd5li
    @chris-cd5li Před 14 dny +1

    this is a a well explained tutorial i have ever seen thank you for sharing knowledge sir

    • @kundankumar011
      @kundankumar011  Před 13 dny

      Pleasure is mine dear to share the knowledge. Welcome ❤️

  • @ishimwejoshua2766
    @ishimwejoshua2766 Před 18 dny +1

    This is a fabulous tutorial indeed. please keep on giving us informative tutorials.

    • @kundankumar011
      @kundankumar011  Před 18 dny

      I am glad to know that this video tutorial was informative. Thank you dear @Joshua❤

  • @pamellamutoniingabire
    @pamellamutoniingabire Před 14 dny +1

    Great tutorial indeed!This was so helpful.clear and concise. Thanks alot for sharing

    • @kundankumar011
      @kundankumar011  Před 14 dny

      Pleasure to know that this tutorial was so helpful and Thank you so much for saying this is one of the great tutorials dear. ❤️

  • @EmmaBemmly
    @EmmaBemmly Před 22 dny +2

    The sign before the direction to put or copy to is changing from forward backslash to backward backslash . 😅

    • @kundankumar011
      @kundankumar011  Před 22 dny +1

      Dear Emmanuel. If I am getting you well. Are you talking about the slash sign. Like hdfs dfs -put C:\example\demo.txt /Kumar/.
      1) Source we are reading the data from local machine from windows. So windows style slash
      2) Destination - we are uploading to HDFS so another style slash
      Hope I didn't confuse you dear. Keep learning 🥰

  • @PhilemonIransubije
    @PhilemonIransubije Před 20 dny +1

    I found this difference:
    -put: Can copy from local file systems or from other compatible file systems (like S3) to HDFS.
    -copyFromLocal: Specifically designed to copy from the local file system to HDFS
    also,
    -put: By default, it will overwrite the destination if the file already exists.
    -copyFromLocal: Will throw an error if the file already exists at the destination
    However, "-put" supports more options and flags for advanced use cases

    • @kundankumar011
      @kundankumar011  Před 20 dny +1

      Cool. Thank you so much for the contribution dear❤️ that's what I need people should contribute in video comment

  • @PhilemonIransubije
    @PhilemonIransubije Před 17 dny +1

    Sir, after uploading a file, it is creating 1 replication for it. i changed the hdfs-site to 2, but no change. any help?

    • @kundankumar011
      @kundankumar011  Před 17 dny

      Okay, dear. Do one thing to confirm this issue. Since you changed the replication factor, if I am not mistaken, it will only affect new data uploads, not the old data already in HDFS. So, just upload some new data to HDFS and see if it shows a replication factor of 2. Let me know if it works dear.

    • @PhilemonIransubije
      @PhilemonIransubije Před 13 dny

      @@kundankumar011 it works for new uploads. thanks :)