Deploy the ECS HDFS Client Library
Use this procedure to put the ECS HDFS Client Library JAR on the classpath of each client node in the Hadoop cluster.
Obtain the ECS HDFS Client Library for your Hadoop distribution from the ECS support page as described in
Obtain the ECS HDFS installation and support package .
The HDFS Client Library uses the following naming convention
viprfs-client-<ECS version>-hadoop-<Hadoop version>.jar and the JAR file for use with ths release is listed in the following table.
Table 1. ECS HDFS Client Library The table lists the ECS HDFS Client Libary details
Hadoop distribution
Version
ECS HDFS JAR
Hortonworks
HDP 2.6.2
viprfs-client-<ECS version>-hadoop-2.7.jar
NOTE:
When you upgrade to a later version of ECS, you must deploy the ECS HDFS Client Library for the release to which you have upgraded.
Log in to a node that has password-less SSH access to all Hadoop nodes.
Run the classpath command to get the list of directories in the classpath:
# hadoop classpath
Deploy the client JAR file to all Hadoop nodes by performing the following steps:
Create a text file named
masters that contains a list of IP addresses or FQDNs for all Hadoop master nodes, one per line.
Create a text file named
workers that contains a list of IP addresses or FQDNs for all Hadoop worker nodes, one per line.
Create the directory
/usr/lib/hadoop/lib on all nodes. Use the following command:
# cat masters workers | xargs -i -n 1 ssh root@{} mkdir -p /usr/lib/hadoop/lib
Copy the ECS client jar to all nodes using the following command:
cat masters workers | xargs -i -n 1 scp viprfs-client-3.2.0.0-hadoop-2.7.jar root@{}:/usr/lib/hadoop/lib/