How to Install Hadoop

This wikiHow teaches you how to install Hadoop on a Windows computer. [[Use-WinRAR
Method 1 of 5:

Preparing to Install Hadoop

  1. How to Install Hadoop Picture 1How to Install Hadoop Picture 1
    Install WinRAR with TAR support. Since you'll need to extract a TAR file to install Hadoop, make sure that you check the "TAR" box when installing WinRAR.
  2. How to Install Hadoop Picture 2How to Install Hadoop Picture 2
    Install Java. To do so:
    1. Go to https://www.java.com/en/download/ and click Free Java Download.
    2. Click Agree and Start Free Download.
    3. Double-click the downloaded Java file.
    4. Click Yes when prompted.
    5. Click Install, then follow any on-screen prompts.
  3. How to Install Hadoop Picture 3How to Install Hadoop Picture 3
    Open the Hadoop page. Go to https://hadoop.apache.org/ in your computer's web browser.
  4. How to Install Hadoop Picture 4How to Install Hadoop Picture 4
    Click Download. It's at the top of the page.
  5. How to Install Hadoop Picture 5How to Install Hadoop Picture 5
    Click binary next to the top result. This will take you to the Binary mirror link page for the most recent version of Hadoop.
  6. How to Install Hadoop Picture 6How to Install Hadoop Picture 6
    Click the recommended link. It's the link below the "We suggest the following mirror site for your download:" line of text near the top of the page. Doing so prompts your computer to begin downloading the Hadoop TAR file.
  7. How to Install Hadoop Picture 7How to Install Hadoop Picture 7
    Open the Java Development Kit (JDK) site. Go to http://www.oracle.com/technetwork/java/javase/downloads/index.html in your browser.
  8. How to Install Hadoop Picture 8How to Install Hadoop Picture 8
    Click DOWNLOAD. You'll find this under the "JDK" heading on the right side of the page.
  9. How to Install Hadoop Picture 9How to Install Hadoop Picture 9
    Check the "Accept License Agreement" box. It's near the bottom of the page.
  10. How to Install Hadoop Picture 10How to Install Hadoop Picture 10
    Click the Windows "Download" link. This is the link under the "Downloads" heading and to the right of the "Windows" category near the bottom of the page. Doing so prompts the JDK setup file to download onto your computer.
  11. How to Install Hadoop Picture 11How to Install Hadoop Picture 11
    Install the JDK. Double-click the JDK's setup file, then do the following:
    1. Click Yes when prompted.
    2. Click Next twice.
    3. Allow the JDK to install, and follow any on-screen prompts if necessary.
Method 2 of 5:

Adding Hadoop to Your Hard Drive

  1. How to Install Hadoop Picture 12How to Install Hadoop Picture 12
    Open the Hadoop TAR file. Double-click the downloaded Hadoop TAR file to do so. It should open in WinRAR.
  2. How to Install Hadoop Picture 13How to Install Hadoop Picture 13
    Click Extract To. It's at the top of the WinRAR window. Doing so opens a pop-up window.
  3. How to Install Hadoop Picture 14How to Install Hadoop Picture 14
    Select your hard drive as the extraction location. In most cases, your hard drive should be labeled OS (C:); click it in the right-hand pane of the pop-up window to select it.
  4. How to Install Hadoop Picture 15How to Install Hadoop Picture 15
    Click OK. It's at the bottom of the window. Doing so will extract the Hadoop folder to your computer's "C" drive. Once the extraction is complete, you can proceed.
Method 3 of 5:

Adding Hadoop and Java Environment Variables

  1. How to Install Hadoop Picture 16How to Install Hadoop Picture 16
    Open This PC. Double-click the This PC app icon, which resembles a computer monitor.
    1. If you don't have This PC on your desktop, click File Explorer
      How to Install Hadoop Picture 17How to Install Hadoop Picture 17
      and then click This PC on the left side of the window.
  2. How to Install Hadoop Picture 18How to Install Hadoop Picture 18
    Open your hard drive. Double-click your hard drive's name (again, usually OS (C:)) below the "Devices and drives" heading.
  3. How to Install Hadoop Picture 19How to Install Hadoop Picture 19
    Open the Hadoop installation folder. Double-click the "hadoop" folder in the list of folders on your hard drive.
    1. You'll see the Hadoop version number after "hadoop" in the folder's name.
  4. How to Install Hadoop Picture 20How to Install Hadoop Picture 20
    Open the "bin" folder. Double-click the "bin" folder to do so.
  5. How to Install Hadoop Picture 21How to Install Hadoop Picture 21
    Copy the address. Click the address bar at the top of the File Explorer to highlight the address, then press Ctrl+C to copy it.
  6. How to Install Hadoop Picture 22How to Install Hadoop Picture 22
    Open Start
    How to Install Hadoop Picture 23How to Install Hadoop Picture 23
    . Click the Windows logo in the bottom-left corner of the screen.
  7. How to Install Hadoop Picture 24How to Install Hadoop Picture 24
    Open the System Variables window. Type in edit the system, then click Edit the system environment variables at the top of the Start menu.
  8. How to Install Hadoop Picture 25How to Install Hadoop Picture 25
    Click Environment Variables…. It's at the bottom of the System Variables window. A new window will appear.
  9. How to Install Hadoop Picture 26How to Install Hadoop Picture 26
    Click New… under the "User variables" section. Doing so opens yet another window.
  10. How to Install Hadoop Picture 27How to Install Hadoop Picture 27
    Name the variable. Type HADOOP_HOME into the "Variable name" text box.
  11. How to Install Hadoop Picture 28How to Install Hadoop Picture 28
    Enter the path to the Hadoop folder. Click the "Variable value" text box, then press Ctrl+V.
  12. How to Install Hadoop Picture 29How to Install Hadoop Picture 29
    Click OK. It's at the bottom of the window. You should now have a "HADOOP_HOME" variable listed in the top pane.
  13. How to Install Hadoop Picture 30How to Install Hadoop Picture 30
    Add Java to the "User variables" section. Go to your hard drive, open the "Program Files" folder, open the "Java" folder, open the "jdk" folder (this folder will have a number after it), and open the "bin" folder, then copy the address. You can then add Java to the environment by doing the following:
    1. Click New... under the "User variables" section.
    2. Type JAVA_HOME into the "Name" text box.
    3. Click the "Variable value" text box, then press Ctrl+V.
    4. Click OK.
  14. How to Install Hadoop Picture 31How to Install Hadoop Picture 31
    Add both addresses to the PATH variable. You can add both the Hadoop address and the Java address to the PATH variable by doing the following:
    1. Click the "Path" heading in the "System variables" section.
    2. Click Edit....
    3. Click New... on the right side of the window.
    4. Paste in the Java address by pressing Ctrl+V, then press Enter.
    5. Go back and copy the Hadoop "bin" folder's address, then click New..., paste it in, and press Enter.
  15. How to Install Hadoop Picture 32How to Install Hadoop Picture 32
    Save your changes to the environment variables. Click OK on all three open System Environment Variables windows to do so.
Method 4 of 5:

Configuring Hadoop

  1. How to Install Hadoop Picture 33How to Install Hadoop Picture 33
    Open the Hadoop installation folder. Go to your hard drive in This PC, then double-click the "hadoop" folder.
  2. How to Install Hadoop Picture 34How to Install Hadoop Picture 34
    Open the "etc" folder. Double-click it to do so.
  3. How to Install Hadoop Picture 35How to Install Hadoop Picture 35
    Open the "hadoop" folder. This should be the only folder in the "etc" folder.
  4. How to Install Hadoop Picture 36How to Install Hadoop Picture 36
    Open the "core-site" file in Notepad. To do so:
    1. Right-click the "core-site" file.
    2. Select Open with in the drop-down menu.
    3. Click Notepad.
  5. How to Install Hadoop Picture 37How to Install Hadoop Picture 37
    Add the proper configuration. Delete the "" tags at the end of the document, then copy and paste in the following code:
    <configuration>   <property>    <name>fs.defaultFS</name>   <value>hdfs://localhost:9000</value>   </property> </configuration> 
  6. How to Install Hadoop Picture 38How to Install Hadoop Picture 38
    Save the document. Press Ctrl+S, then click OK if prompted. You can then close the document.
  7. How to Install Hadoop Picture 39How to Install Hadoop Picture 39
    Open the "mapred-site" file in Notepad. You should see a file similar to the "core-site" file open.
  8. How to Install Hadoop Picture 40How to Install Hadoop Picture 40
    Add the proper configuration. Delete the "" tags at the end of the document, then copy and paste in the following code:
    <configuration>  <property>     <name>mapreduce.framework.name</name>     <value>yarn</value>  </property> </configuration> 
  9. How to Install Hadoop Picture 41How to Install Hadoop Picture 41
    Save the document. Press Ctrl+S, then click OK if prompted. You can then close the document.
  10. How to Install Hadoop Picture 42How to Install Hadoop Picture 42
    Go back to the "hadoop" installation folder. Click the "hadoop" folder which includes the Hadoop version number in the address bar.
  11. How to Install Hadoop Picture 43How to Install Hadoop Picture 43
    Create a new folder named "data". To do this, right-click a blank space in the window, select New, click Folder, type in data, and press Enter.
  12. How to Install Hadoop Picture 44How to Install Hadoop Picture 44
    Open the "data" folder. Double-click it to do so.
  13. How to Install Hadoop Picture 45How to Install Hadoop Picture 45
    Create two new folders named "datanode" and "namenode". When you're done, you should have a "data" folder that has one folder named "datanode" and one folder named "namenode".
  14. How to Install Hadoop Picture 46How to Install Hadoop Picture 46
    Open the "hdfs-site" file in Notepad. You'll find this file in the "hadoop" folder that's inside the "etc" folder from earlier.
  15. How to Install Hadoop Picture 47How to Install Hadoop Picture 47
    Add the proper configuration. Delete the "" tags at the end of the document, then copy and paste in the following code:
    <configuration>  <property>    <name>dfs.replication</name>    <value>1</value>  </property>  <property>    <name>dfs.namenode.name.dir</name>    <value>C:hadoop-2.8.0datanamenode</value>  </property>  <property>     <name>dfs.datanode.data.dir</name>    <value>C:hadoop-2.8.0datadatanode</value>  </property> </configuration> 
  16. How to Install Hadoop Picture 48How to Install Hadoop Picture 48
    Save the document. Press Ctrl+S, then click OK if prompted. You can then close the document.
  17. How to Install Hadoop Picture 49How to Install Hadoop Picture 49
    Open the "yarn-site" file in Notepad. This file is also in the "hadoop" folder.
  18. How to Install Hadoop Picture 50How to Install Hadoop Picture 50
    Add the proper configuration. Delete the "" tags at the end of the document, then copy and paste in the following code:
    <configuration>   <property>     <name>yarn.nodemanager.aux-services</name>     <value>mapreduce_shuffle</value>   </property>   <property>   <name>yarn.nodemanager.auxservices.mapreduce.shuffle.class</name>   <value>org.apache.hadoop.mapred.ShuffleHandler</value>   </property> </configuration> 
  19. How to Install Hadoop Picture 51How to Install Hadoop Picture 51
    Save the document. Press Ctrl+S, then click OK if prompted. You can then close the document.
  20. How to Install Hadoop Picture 52How to Install Hadoop Picture 52
    Open the "hadoop-env" file in Notepad. Simply right-click this file and then click Edit to do so.
  21. How to Install Hadoop Picture 53How to Install Hadoop Picture 53
    Update the Java path. Find the set JAVA_HOME=%JAVA_HOME% line, type @rem in front of it, and then type below it the phrase "set JAVA_HOME=" followed by your Java JDK folder's address (not the "bin" folder's address). For example, your line might resemble the following:
    @rem set JAVA_HOME=%JAVA_HOME% set JAVA_HOME=C:Program FilesJavajdk-10.0.2 
Method 5 of 5:

Applying the Hadoop Fix

  1. How to Install Hadoop Picture 54How to Install Hadoop Picture 54
    Download and extract the Hadoop fix file. Open the fix file's Google Drive page and click Download, then extract it by doing the following:
    1. Double-click the fix file.
    2. Click Extract To.
    3. Click Desktop.
    4. Click OK.
  2. How to Install Hadoop Picture 55How to Install Hadoop Picture 55
    Open the extracted fix file. Once the file finishes extracting, double-click it to open it.
  3. How to Install Hadoop Picture 56How to Install Hadoop Picture 56
    Copy the "bin" folder. Click once the "bin" folder to select it, then press Ctrl+C to copy it.
  4. How to Install Hadoop Picture 57How to Install Hadoop Picture 57
    Open the Hadoop installation folder. Go to your hard drive's folder, then double-click the "hadoop" folder there.
  5. How to Install Hadoop Picture 58How to Install Hadoop Picture 58
    Paste in the "bin" folder. Press Ctrl+V to do so.
  6. How to Install Hadoop Picture 59How to Install Hadoop Picture 59
    Click Replace the files in the destination when prompted. Once this process is complete, Hadoop should be installed on your computer.
3.7 ★ | 3 Vote