ECS 3.6.2 Data Access Guide

Integrate a secure Hadoop cluster with ECS HDFS

You can integrate your existing Hadoop distribution, that is secured using Kerberos, with ECS HDFS.

You must perform a non-secure installation of Hadoop and ECS completely before optionally enabling Kerberos.

Before performing the integration steps, you must do the following:

• Verify that a Kerberos Key Distribution Center (KDC) is installed and configured to handle authentication of the Hadoop service principals. If you are using Active Directory to authenticate ECS users, you must set up a cross-realm trust between the Kerberos realm and the ECS user realm. For guidance on setting up the Kerberos KDC and configuring trust, see Setup the kerberos KDC.

• Ensure that you have created a bucket for the HDFS file system (see Create a bucket for HDFS using the ECS Portal).
• Ensure that you have read the guidelines for planning the integration (see Plan the ECS HDFS and Hadoop integration).
• Ensure that you have downloaded the installation and support package (see Obtain the ECS HDFS installation and support package).

To integrate ECS HDFS with your secure Hadoop cluster, complete the following tasks:

1. Plan migration from a simple to a Kerberos cluster
2. Map group names
3. Configure ECS nodes with the ECS service principal
4. Secure the ECS bucket using metadata
5. Reconfigure ECS client properties
6. Start Hadoop services and verify Hadoop access to ECS