Hadoop Single Node Setup{தமிழ்}

Sdílet
Vložit
  • čas přidán 11. 11. 2020
  • Hadoop Installation Steps - github.com/atozknowledge/bigd...
    Ubuntu installation Steps - • Virtual computing by V...
    Video Playlist
    -----------------------
    Hadoop in Tamil - bit.ly/32k6mBD
    Hadoop in English - bit.ly/32jle3t
    Spark in Tamil - bit.ly/2ZzWAJN
    Spark in English - bit.ly/3mmc0eu
    Hive in Tamil - bit.ly/2UQVUgv
    Hive in English - bit.ly/372nCwj
    Data Engineering in Tamil - bit.ly/2x0r0tG
    Data Engineering in English - bit.ly/2UIU2ac
    Batch vs Stream processing Tamil - • Data - Batch processi...
    Batch vs Stream processing English - • Data - Batch processi...
    NOSQL in English - bit.ly/2XtU07B
    NOSQL in Tamil - bit.ly/2XVLLjP
    Scala in Tamil: goo.gl/VfAp6d
    Scala in English: goo.gl/7l2USl
    Email : atozknowledge.com@gmail.com
    LinkedIn : / sbgowtham
    Instagram : / bigdata.in
    CZcams channel link
    / atozknowledgevideos
    Website
    atozknowledge.com/
    Technology in Tamil & English
    #bigdata #hadoopframework #dataengineering
  • Věda a technologie

Komentáře • 58

  • @dataengineeringvideos
    @dataengineeringvideos  Před 2 lety +5

    If the Resource Manger daemon is not started, please go to yarn-site.xml file and replace {yarn.resourcemanager.hostname}:8032 to localhost:8032 , now start the Hadoop

    • @SCREENERA
      @SCREENERA Před rokem

      Bro,make one small video for this resource manager issue... please

    • @sivasakthi76
      @sivasakthi76 Před rokem

      A dollar symbol is missing. "${yarn.resourcemanager.hostname}:8032". This will work.

  • @selvaganesh8115
    @selvaganesh8115 Před 2 lety

    Thank you so much brother.. I was struggling with hadoop set up after deleting already used version.. After your video I' ve installed within 30 minutes which I was doing for 3 days.. The ssh command really helped because which the name node didn't start initially after setting up correct ssh.. It worked well. Thanks a lot for your contribution bro😍😍

  • @done1341
    @done1341 Před 3 lety +3

    Super Bro! Very Detailed Installation.. Quite Interesting.. Can you give some sample programs how to do in hadoop... like word count okay other than that..

  • @Sundar_Tenkasi
    @Sundar_Tenkasi Před 5 měsíci

    Nice explanation
    Trying in my personal laptop
    As it has windows OS only
    Installing Linux Ubuntu before that with the help of your Mother Linux instalation video

  • @rishabkumar9578
    @rishabkumar9578 Před 2 lety

    Bro ur teaching is Ultimate !!!

  • @balajivenkatraman2991
    @balajivenkatraman2991 Před 2 lety

    BIG Thank You Gowtham. I am able to setup HDFS on VM, Am planning to set up one streaming project to load the data in No SQL. Defininetly I would need your help. Thanks again brother.

  • @abcd286123
    @abcd286123 Před 2 lety

    Hi Bro, this is really very helpful video. thank you so much.

  • @sijok1151
    @sijok1151 Před rokem

    Romba useful la eruthu bro..... thanks bro

  • @jaikarthick5754
    @jaikarthick5754 Před 3 lety

    Tried many videos to install hadoop.. But u r the best.. I installed linux os as u adviced and did all steps. Finally it's working thanks alot

    • @dataengineeringvideos
      @dataengineeringvideos  Před 3 lety

      Happy to see 👍🙏

    • @muthukumar-gp5dk
      @muthukumar-gp5dk Před 2 lety

      Hi jai, could you please help me for install linux and how much space and Ram we need to allocate for hadoop setup

  • @rajadurai3355
    @rajadurai3355 Před 2 lety +2

    bro while formating the namenode it shows error like this
    in this step bro => bin/hadoop namenode -format
    DEPRECATED: Use of this script to execute hdfs command is deprecated.
    Instead use the hdfs command for it.
    /home/don/hadoop-2.9.2/bin/hdfs: line 319: /home/Don/jdk-18.0.1.1/bin/java: No such file or directory
    please help me bro

  • @muthukumar-gp5dk
    @muthukumar-gp5dk Před 2 lety

    Hi bro, could you please help to install the Linux for big data. I want to know how much space we need and Ram details to install linux

  • @sanjays7255
    @sanjays7255 Před 3 měsíci

    Hi Bro,i have an doubt ,in the video 7:44 ,you're change/modify the bashrc manually , can we use 'sudo gedit' for modify a file?

  • @praveenkumar2808
    @praveenkumar2808 Před 2 lety

    am gwtting java home not found error whike formattimg... done bashrc and env setup also..

  • @narenbot
    @narenbot Před 7 dny

    Thank you so much bro for the wonderful explanation. 😇 I have created the hadoop cluster. Once I create any folder or files in hadoop, it is not reflecting in browse file system. Showing error as: Failed to retrieve data from /webhdfs/v1/?op=LISTSTATUS: Cannot invoke "com.sun.jersey.spi.container.WebApplication.isTracingEnabled()" because "wa" is null...... Please give solution to this.

  • @arjunmr9811
    @arjunmr9811 Před 3 lety

    Bro, I need to install 2 datanode and one namenode in a single machine. Please guide me bro

  • @varunpandian3477
    @varunpandian3477 Před 2 lety

    error in installing Resource manager and node manager command what i have to do now?

  • @nanthagopal7113
    @nanthagopal7113 Před rokem

    hi brother when i giving "bin/hadoop namenode -format" result like permission denied whats the solution to get the permission
    ?

  • @vigneshwaran5029
    @vigneshwaran5029 Před 2 lety

    After started Hadoop resource manager and node manager not running how to solve that pblm ?

  • @sundharp1716
    @sundharp1716 Před 2 lety

    Bro ssh localhost kodutha connect to host localhost port22:connection refused nu varuthu

  • @user-zr9zu1hs2r
    @user-zr9zu1hs2r Před 10 měsíci

    can i use mac os for learning purpose bro?

  • @muthukumaran4192
    @muthukumaran4192 Před 2 lety

    @Gowtham, please share video link to install ubuntu through VMware

  • @tonydensingh3782
    @tonydensingh3782 Před 2 lety

    Brother resource manager UI vara matithu ena panrathu?

  • @asardeen3593
    @asardeen3593 Před 3 lety +1

    can you share the Pyspark tutorials from your end...

  • @mahalakshmimahalakshmi7254

    Can you explain multi node cluster in Hadoop please bro

  • @subashp626
    @subashp626 Před 2 lety

    bro jps panuna resource manager node run agala bro. enna reason bro

  • @manishchander7759
    @manishchander7759 Před 3 lety

    Really Awesome Video

  • @Artlessvoiceover
    @Artlessvoiceover Před 8 měsíci

    Bro Kali Linux la use pannalam ha Hadoop

  • @sasi7913
    @sasi7913 Před 3 lety

    Is java mandatory for big data?

  • @prabhakarravi2671
    @prabhakarravi2671 Před 7 dny

    Thank you so much Bro

  • @78vijayk37
    @78vijayk37 Před rokem

    Bro windows installation panna mudiyautha

  • @tonydensingh3782
    @tonydensingh3782 Před 2 lety +2

    Brother install panitu resource manager web UI pona vara matithu enna panrathu? Pls tell me

    • @rakulchandru7002
      @rakulchandru7002 Před 2 lety

      Same issue i'm also facing bro. Is there any way to resolve this

    • @dataengineeringvideos
      @dataengineeringvideos  Před 2 lety +3

      Hey bro
      In yarn-site.xml change the last property host name as loclhost:8032 instead of passing the variable name and then restart the Hadoop

  • @raghav6516
    @raghav6516 Před 2 lety

    Bro i can't able to write or add text in .basrc file, cursor doesn't goes below fi what can i do? please respond

  • @shamukarthik7188
    @shamukarthik7188 Před 2 lety +1

    Bro my laptop having 4GB ram only can i install linux through vmware and install hadoop?

  • @mohamedrafiyudeent3162

    Bro I done all the steps, and getting the error on the format steps
    Like :
    Error: Could not find or load main class org.apache.hadoop.hdfs.server.namenode .NameNode
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hdfs.server.name node.NameNode

    • @ajay_sn
      @ajay_sn Před 7 měsíci

      Have u done all the property set in all the XML files ??

  • @ramananloganathan8954

    hi bro i am getting this error
    Caused by: java.lang.reflect.InaccessibleObjectException: Unable to make protected final java.lang.Class java.lang.ClassLoader.defineClass(java.lang.String,byte[],int,int,java.security.ProtectionDomain) throws java.lang.ClassFormatError accessible: module java.base does not "opens java.lang" to unnamed module @93c2679
    nodemanager and resource manager not working rest all were working

    • @ajay_sn
      @ajay_sn Před 7 měsíci

      Check his description he has mentioned a key point

  • @piraviperumal2544
    @piraviperumal2544 Před rokem

    Loved it!

  • @analyticstamizan677
    @analyticstamizan677 Před 11 měsíci

    Sema bro👍💯

  • @Pradeepkumar-hz7mc
    @Pradeepkumar-hz7mc Před rokem

    Thanks bro

  • @prakashk7906
    @prakashk7906 Před 2 měsíci

    jbs command not woking brother 32:19

  • @poovendranalagarsamy9810

    Hi, i have seen your Bigdata videos. its amazing. i learned lot. Thanks for that. Need bit more on Spark and Multi clustering with Hadoop tutorial pls. I have a 2 years experience in Bigdata Engineer and can i get a chance for abroad opportunities rightnow?

  • @kalyanirvs
    @kalyanirvs Před 3 lety

    Hi brother...! I followed all the steps finally the name node got successfully formatted but when I run jps command resourcemanager is not running
    Please tell me what will be the issue

    • @dataengineeringvideos
      @dataengineeringvideos  Před 3 lety

      in the hadoop installation directory there will an log folder , pls open that log folder and there will be log for resource manager , open the log and you will see the actual error , share that here

    • @kalyanirvs
      @kalyanirvs Před 3 lety +1

      Thanks a lot brother👍🏻actually I forgot to mentioned the host name for resource manager... now it’s working good 👍🏻

    • @kumaranc.s9731
      @kumaranc.s9731 Před 2 lety

      @@kalyanirvs Hai, I also got same error. how to solve..??