Easy Hadoop Installation on Windows 10/11 - Step-by-Step Guide | Kundan Kumar
Vložit
- čas přidán 9. 07. 2024
- In this Video tutorial, learn how to install Hadoop on your Windows 10 or 11 system effortlessly. Follow our step-by-step guide to set up Hadoop for big data processing and analytics right on your local machine. No more struggles with installation - we've got you covered!
1) To Download Hadoop of your choice version: archive.apache.org/dist/hadoo...
2) Download HadoopFixedBin Folder Here: drive.google.com/drive/folder...
3) To access the Hadoop GUI, follow these steps after starting the daemons (start-all.cmd):
4) For Name Node Information:
URL: localhost:50070/
5) For the Hadoop Cluster:
URL: localhost:8088/
Awesome after many tutorials I can't do it but now, I made it in One-go, thankyou sirr..
@@SaiNirmalReddyGavini-k2o I am glad to know that this tutorial was helpful for you as well❤️. Welcome dear. Nirmal Reddy. Hope you do subscribed to my channel
well done, Kumar ...
it was so useful.
Glad to know that this video was helpful to you as well ❤️ Thank you so much for subscribing my channel. 🙌
Watched a lot of videos , but yours worked the better . you even delt with the programe files space error, may videos , dont even deal with that .. awsome work
Glad to know that this video was so helpful to you❤️. Thank you for appreciating the video. Please do you subscribe to my channel and encourage me.
Excellent, I followed the steps and it worked very well for me. Thank you so much
Pleasure to know that you followed the steps and worked very fine. ❤️ Please you do encourage me by subscribing my channel dear.
You help me a lot, thank you! Hope you will make more videos like this.
Pleasure to know that this video is helpful for you. Ya sure, I will keep trying to make such helpful video. Kindly request you to subscribe my channel if you not yet. ❤️
I cant change the destination folder.After status it doesnot shows destination folder .
Thank you so much for watching my video. I think you are talking about changing the destination folder to install Java? If yes, System must allow you change if still not. No worry you can choose the default destination then use the same destination path location to setup environmental variable dear. Just continue watching the video. Let me if this helped you? And encourage me by subscribing my channel dear❤️
Thank you so must. You explain everything in detail which helps me alot.
I'm glad to know that this was very helpful to you❤️ if you have not yet subscribe my channel you do subscribe my channel and encourage me dear. 🙏
Very helpful video. Works perfectly. It saved me a lot of time. Thanks a lot
Pleasure to know that this video is Very helpful to you. Please you do subscribe my channel and encourage me ❤️
Hello Dr, I have a problem with Hadoop. I got this error: Failed to retrieve data from /webhdfs/v1/?op=LISTSTATUS: Server Error
Thank you so much for the comment dear. can you provide more details. I meant what activity cause or prompt this error??
I have been trying to install hadoop for a week. Finally it works now. Thankyou so much sir for this video 🥺🩷🩷
I am happy to know that this video was very helpful for you to install Hadoop successfully❤️. Please you subscribe to my channel if not yet and encourage me
Thank you so much for subscribing to my channel 💖💖💖
May god bless you sir. It worked just fine
Pleasure to know ❤️
If you have not yet subscribed my channel. Please you do subscribe my channel. Your subscription will motivate me make more videos ❤️
Thanks You So Mach....Great Video For Install Hadoop...❤❤
@EvrythingSimple Great to Know that this was helpful for you and Thank you so much for appreciating this video. Pleased you do subscribe my channel and encourage me.
i got this error when running start-all.cmd in C:\hadoop\sbin (SHUTDOWN_MSG: Shutting down NodeManager) i was not able to open localhost:8080
please help me
Hi dear. I am so sorry for being late to reply this serious issues. I apologies. It seems like there might be an issue with your Hadoop setup, specifically with the NodeManager shutting down. Check Configuration: Ensure that your Hadoop configuration files (core-site.xml, hdfs-site.xml, yarn-site.xml, etc.) are properly configured. Pay special attention to the NodeManager configuration in yarn-site.xml. Let me know if this helped you?
Hello Sir, nodemanager is shutting immediately when i start hadoop services and it is showing this error: Permissions incorrectly set for dir /tmp/hadoop-phile/nm-local-dir/usercache, should be rwxr-xr-x, actual value = rwxrwxr-x, i tried to set the above permissions it needs, but still it is shutting down. also, i am wondering how is the tmp folder related to hadoop services since it is created authomatically when they are started? any hint? thanks :)
Hello dear. Check the owner of the tmp folder. Who is it? I mean, you are logging into the system using some user and then running Hadoop. Make sure that the owner has all the permissions.
@@kundankumar011 i found that i was using a microsoft account which caused the error.
@@PhilemonIransubije congratulations 👏
Thank you so much. It's very useful for me.
Pleasure to know that this video was so useful for you ❤️. If you didn't subscribe my channel yet, please you do subscribe my channel and press bell icons not to miss next videos.
What size RAM do you need? after can you show us the installation of kerberos and warden?
I missed your comment earlier, and I apologize for that. I'll make sure to prioritize working on the requested video. Regarding Hadoop, while 8GB RAM is sufficient, but it depends on different factors. Like what size of datasets you have? upgrading to 16GB RAM would indeed improve performance.
Thank you for the instructions sir❤❤
Pleasure to know dear @Sanjay. If you have not subscribed my channel please you do subscribe my channel to motivate me ❤️
sir for me that port number is not showing hadoop, but 8000 series port showing namenode details. how do i get to know which port will display the hadoop information?
Hello Dear. Thank you for watching my video and asking question. Did you try localhost:9870??
Ports: The port information is indeed specified in the Hadoop configuration files. Here's how to find port information in those files:
For the core-site.xml file, look for the fs.defaultFS property. It specifies the default filesystem name, which includes the hostname and port. For example:
fs.defaultFS hdfs://namenode-hostname:9000
Hope you got me well dear? If you like my video please you do subscribe my channel to motivate me ❤️
@@kundankumar011
thx for replying sir. i tried with port 9000 also. is there any way to know that i can check hadoop port working is?
its working thx
@@user-rk4zq2lf1b cool. Enjoy learning Hadoop
@@user-rk4zq2lf1b you subscribe my channel dear. Your subscription will motivate me ❤️
Sir my dataNode is not displaying in jps
what should i do
Sorry for late response dear Akash. I missed to see your comment. 1) Check Configuration Files: Verify that your hdfs-site.xml and core-site.xml configuration files are correctly set up. Pay attention to the dfs.datanode.data.dir property in hdfs-site.xml, which defines the directory where DataNode stores its data. Ensure the paths are correct and accessible. 2) Hope ava Version is ok for you. 3) Formate the namenode before start daemons.
Thankyou soo much sir i have been trying to install from past 3 days by seeing multiple videos, but failed and successfuly installed in one shot as you have explained 🎉
I am glad to hear that this video helped you to install Hadoop in one shot. Hope you do subscribed my channel please. Your subscription motivates me to bring more interesting video
when I am clicking on winutils I am getting an error "the application was unable to start correctly" please help
Hi dear. Thank you for watching my this video. Hope it was helpful. But if I am getting you well, try to download winutils file from given resources at my video description and paste it into your Hadoop configuration as guided in the video then try to see if still you gave an error. ❤️ If you have not subscribed my channel, please you do subscribe , like and share. Your subscription will motivate me more 🙏
thnk u for this video, it helped me a lot
Dear Salah. It's pleasure to know that this video was very helpful for you ❤️. If you not yet subscribe my channel please you do subscribe and encourage me 🙌
@@kundankumar011 I already did 👌
After insralling winrar showing only console RAR manual,what is new in latest version,winRAR help,winRAR this file but not showing hadoop file help me
Thank you so much for watching my video and it's always pleasure to help. Here is the link to download latest WinRar dear. www.win-rar.com/download.html?&L=0 . If you have not yet subscribe my channel. please you do subscribe. Your subscription is motivation for me. ❤️
@@kundankumar011 still showing same
@@rt7687 After installing WinRar. Extract the Hadoop.tar file then you will find extracted Hadoop file. Follow instructions in video how to extract hadoop.tar file and rest.
@@kundankumar011 thank you
sir under jps command my data node is not running
Thank you so much for watching my video. Hope you didn't forget to format the namenode and datanode folder. In same video, there is instructions how to format it. Addition to this, if really this video is helpful for please you do subscribe my channel dear. Your subscription is my motivation ❤️
is it running now?
@@SatyamSingh-ll7ib yeah its running smoothly
this is very wondeful and helpful
Thank you so much Jackson ❤️
sir, will this tutorial work for hadoop 2.7 ?
Thank you so much dear for reaching out to clear your doubt on the Hadoop installation. Actually we follow the same steps for Installing any version of Hadoop so far. So this video must help you to configure it. If not let me know what the issues are occurring.
Hello Sir. Thank you for this video but i am facing this error "Error: Could not find or load main class Dev
Caused by: java.lang.ClassNotFoundException: Dev ", when i run the hdfs namenode -format command.. and my computer name is Malaperi Dev. Thank you
Thank you so much for watching this video. Sorry for the error promoted. I am traveling. Give me a few minutes to settle down myself then help you to fix this error . Hope it's ok with you dear. If you have not yet subscribed to my channel yet. Please do subscribe and encourage me. Soon get back to you ❤️
Hello dear,There could be many reasons causing this error. I am assuming you have configured all Hadoop files correctly and set up the environment variables. Please try this first:
I noticed there is a space in your computer name, "Malaperi Dev." Rename your computer to "MalaperiDev" without any spaces. Make sure there are no spaces in the name. After renaming, restart your computer and check if the error is resolved. if not let me know what is the error again?
Still Negative, i renamed it from Malaperi Dev to kisvan, but still the same error with that "Dev" infront
@@kisivaniAIntelligence Ensure the Hadoop and Java installation paths do not contain spaces in them and also Review your Hadoop configuration files (core-site.xml, hdfs-site.xml) for any paths or classpath entries that reference the computer name directly.
If i run this command >start-all
it runs right away, but if and only if i run that namenode -format it will bring me the same error
for me yarnmanager and namenode manager is not running 😞
Hi dear. Thank you for watching my video. Hope you didn't forget to format namenode and datanode using commanline?
Perfect Ma mann, Keep it up
Thank you so much Abdullah for motivating me ❤️ Hope you didn't forget to subscribe my channel.
@@kundankumar011 Already done, And I was wondering, When I try to upload a datset into the hdfs, I see an error "Couldn't upload the file jfk_weather_cleaned.csv.". So have you made the next video you mentioned in the end of this video so that I would be better able to get the insights on it.. Regards
@@AbdullahKhan-pl7py Dear Abdullah. You can upload the file to hdfs using the command or the GUI interface. At the end of video at 22:50 minutes, I just showed an interface how to upload files on hdfs. May I know what the error is?
@@kundankumar011 "Couldn't upload the file Perecipitationhourly.csv." that is the error which is coming whenever I try to upload it, BTW thanks for cooperating, Your reply is highly appreciated man.
@@AbdullahKhan-pl7py Thank you so much for the appreciation. I will look into this and get back to you dear.
Thank you so much sir ji
Pleasure dear ❤️ please Subscribe my channel to motivate me
When i give the jps command its not showing the daemons
Hello dear. Make sure you have started Hadoop daemons.
@@kundankumar011 yes I started
@@DeepaDeepa-yb6bw If You started daemons and still not showing . Check The followings:
1) Check Configuration: Ensure that your Hadoop configuration files (core-site.xml, hdfs-site.xml, and yarn-site.xml) are correctly configured with the right settings. Pay attention to file paths, ports, and other configurations.
2) Hadoop Formatting: If this is a fresh installation, make sure you've formatted the HDFS file system using the hdfs namenode -format command before starting the daemons.
If really you like my video and found its helpful. please you do subscribe my channel dear.
my hadoop 9870 port is working but 8000 port is not working help!
Try 8088
Hi Harsh, I am sorry for being late to reply. It just sliped from mind. Hope 8088 port working as @shatrughnpinjari5752 suggested. Please let me know if still i can help you dear Harsh.
Can I install Hadoop in windows 4 GB RAM?
@DeepaDeepa Yes, you can install Hadoop on a Windows system with 4 GB of RAM, but it's important to note that Hadoop is a resource-intensive framework, and running it on a machine with limited RAM may lead to performance issues or even failures for certain workloads. It's recommended to have more RAM for better performance and stability, especially if you plan to work with large datasets. You may encounter memory-related problems with only 4 GB of RAM, so be prepared for potential limitations. Hope you got me well. If you like my videos please you do #subscribe my channel. Please
now 25.08.2023 ,when i download hadoop i dont get in a zip file i got in .tar.gz format ?
@Swetha. Thank you for watching my video ❤️. Yes, it's true that you'll receive a .tar.gz file. However, in the same video, I've demonstrated the process of unzipping this downloaded file using the WinRar application. To unzip the hadoop.tar.gz file, please make sure to install WinRar. You can visit this site www.win-rar.com/download.html?&L=0 If you like my video, please you do subscribe my channel and press bell icons, Like and share. If still you have challenge please let me know, I will be happy to guide you
Thank you sir 😊
Pleasure Dear Shiva ❤️
please You do subscribe my channel 🥰
Thank you very much , it is very use full video.
If possible could you plz do one more video, how to install Apache Spark on top of this Hadoop env. and how to integrate Hadoop, hive and Spark.
@Sathish Thank you so much for appreciating this video tutorial and subscribing my channel ❤️l. Let me work on your request as early as possible on Hadoop Spark And hive integration and upload. 👍
Hi dear Satish. Hope you are learning well. I am sorry to delay making a video on hive as you had requested king ago but I was quite busy on different projects. But now I have already made video in easy hive installation for Hadoop. You can find it here czcams.com/video/CL6t2W8YC1Y/video.htmlsi=Gx_jMbUZK6vxy76t
Thank you
Welcome ❤️ and thank you so much you to for watching this video. Please you do subscribe to my channel to offer support and encouragement
okay@@kundankumar011
thanks sir
Thank you so much Aditayan ❤️. If you like my video. please you do subscribe my channel. Your subscription will motivate me.
Sir it's showing couldn't find or load main class
Hello Bhavana, appreciate your time watching my video. Could you provide more detailed feedback? This will help me guide you in fixing the errors?
Hi Bhavana. Did you cross check Hadoop Classpath is set correctly?
Hi Bhavana. If you like my video and it's helpful for you. Please you do subscribe and press well icon to receive notification on next video upload. ❤️
JPS is not working
Thank you for watching this video. I hope you have configured the files properly. Afterward, try using start-all.cmd to initiate all daemons. If you are still encountering issues, please provide more information so I can assist you more effectively. Please you do subscribe my channel to motivate me.
شكرا لك من القلب على شرحك الجميل
Pleasure to Know Heydar that you like my explanations💖. Please you do subscribe my channels if not yet.
If you not yet subscribe my channel please you do subscribe my channel dear. ❤️
pls send a link
@Priya Here you can find winutils under the bin folder of shared linked here. (This link was attached in video descriptions as well) drive.google.com/drive/folders/1WTSipe8W8OXkpFPDVzhI71otRvh4htmP?usp=sharing
if you like my video and you find its helpful, please you subscribe my channel, your subscription motivate me
all the daemons are working except the datanode
Hope you managed to format the namenode and datanode folder before running daemons. In same video, instruction is given how to format namenode and datanode. Please you do subscribe my channel ❤️
Jps error
Thank you so much for watching this video. There could be many reasons
1) Make sure Java is installed correctly on your system and that the JAVA_HOME environment variable is set properly.
2) Hope Hadoop environment is set up well: If you're running "jps" outside of the Hadoop environment or if Hadoop is not properly configured, it may not recognize the Hadoop processes. etc .
If really this video was helpful please you do subscribe my channel and encourage me ❤️
sir i cant find 3.2.4 winutils
@Priya Here you can find winutils under the bin folder of shared linked here. (This link was attached in video descriptions as well) drive.google.com/drive/folders/1WTSipe8W8OXkpFPDVzhI71otRvh4htmP?usp=sharing
if you like my video and you find its helpful, please you subscribe my channel, your subscription motivate me