DarkMatter in Cyberspace
  • Home
  • Categories
  • Tags
  • Archives

Hadoop 1.2.1 Up and Running


Pseudo-distributed Mode

  1. Download Oracle jdk-6u45-linux-i586.bin from Oracle website. Openjdk is unsuitable here because some package like sun.net.dns.ResolverConfiguration only exists in rt.jar of Oracle jdk;

  2. Install (run ./jdk-6u45-linux-i586.bin under ~/apps) this jdk at ~/apps with current user (do not install it into /opt with root user, because this will cause access restriction of rt.jar of jdk);

  3. Add $JAVA_HOME and $CLASSPATH into /etc/profile and re-log into OS to validate:

    export JAVA_HOME=/home/lichao/apps/jdk1.6.0_45 
    export PATH=$PATH:$JAVA_HOME/bin 
    export CLASSPATH=$CLASSPATH:$JAVA_HOME/lib:$JAVA_HOME/jre/lib
    
  4. Follow Single Node Setup.

Verified this morning: 2013-8-9, Linux Mint 14 32bit, Hadoop 1.2.1.

Distributed Mode

  1. Create user hadoop in host 23, 31, 49 and 139;

  2. Create apps and warez folder in home directory on all hosts above;

  3. Copy jdk-6u45-linux-i586.bin from Oracle and hadoop-1.2.1.tar.gz to warez directory to all above hosts;

  4. Unzip jdk6u45 and hadoop to ~/apps;

  5. modify $JAVA_HOME as "/home/hadoop/apps/jdk1.6.0_45" in ~/apps/hadoop-1.2.1/conf/hadoop-env.sh;

1.



Published

Aug 10, 2013

Last Updated

Aug 10, 2013

Category

Tech

Tags

  • hadoop 7
  • linux 158

Contact

  • Powered by Pelican. Theme: Elegant by Talha Mansoor