Now re-load the environment variables to the opened session or close and open the shell. bashrc file in vi editor and add below variables. Once your download is complete, unzip the file’s contents using tar, a file archiving tool for Ubuntu and rename the folder to hadoop.Ģ.2 Apache Hadoop configuration – Setup environment variables.Īdd Hadoop environment variables to. 2.1 Apache Hadoop Installation on all Nodesĭownload Apache Hadoop latest version using wget command. In this section, you will download Apache Hadoop and install on all nodes in a cluster (1 name node and 3 data nodes). Post JDK install, check if it installed successfully by running java -version 2 Download and Install Apache Hadoop Sudo apt-get -y install openjdk-8-jdk-headless If you wanted to to use other JDK please do so according to your need. ssh/authorized_keys datanode3:/home/ubuntu/.ssh/authorized_keysĪpache hadoop build on Java hence it need Java to run. ssh/authorized_keys datanode2:/home/ubuntu/.ssh/authorized_keys ssh/authorized_keys datanode1:/home/ubuntu/.ssh/authorized_keys This enables name node to connect to data nodes password less (without prompting for password) Now copy authorized_keys to all data nodes in a cluster. By using > it appends the contents of the id_rsa.pub file to authorized_keysĬat. rw- 1 ubuntu ubuntu 1679 Dec 9 00:17 id_rsaĬopy id_rsa.pub to authorized_keys under ~/.ssh folder. rw-r-r- 1 ubuntu ubuntu 397 Dec 9 00:17 id_rsa.pub hence let’s generate key-pair using ssh-keygen The name node will use an ssh-connection to connect to other nodes in a cluster with key-pair authentication, to manage the cluster.
1.3 Setup Passwordless login Between Name Node and all Data Nodes.
0 kommentar(er)
