Creating and Registering the Custom Cluster Template
Create and register the custom cluster template to add BDP_PEP service and the required service configurations to the Data Hub cluster.
To Create the Custom Cluster Template with the BDP PEP service:
- Log in to the Cloudera Management Console.
- Navigate to Shared Resources > Cluster Templates. The Cluster Templates page appears.
- Click Create Cluster Template. The Register Cluster Template page appears.
- In the Name box, enter a name for the template.
- In the Description box, enter an explanation for the template.
- Open any text editor.
- Copy the JSON content of the required cluster template that you want to use. For example, Data Engineering or Data Mart.
- On the cluster template JSON, search for the services key, whose value is a JSON array of JSON objects.
- Add the following JSON objects to that array of services:
{ "refName": "bdp_pep", "serviceType": "BDP_PEP", "displayName": "BDP PEP", "roleConfigGroups": [ { "refName": "bdp_pep-PTY_RPAGENT-BASE", "roleType": "PTY_RPAGENT", "base": true, "configs": [ { "name": "rpa_sync_host", "value": "{{{rpa_sync_host}}}" } ] }, { "refName": "bdp_pep-PTY_LOGFORWARDER-BASE", "roleType": "PTY_LOGFORWARDER", "base": true, "configs": [ { "name": "auditstore_ip_port_list", "value": "{{{auditstore_ip_port_list}}}" }, { "name": "auditstore_type", "value": "{{{auditstore_type}}}" }, { "name": "enable_applog_file", "value": true } ] } ] }The service object is position-independent within the array and can be placed at the beginning or end of the array.
Adding the BDP_PEP service to the array of services will ensure that the service is added to the Data Hub cluster during the cluster creation, when the Cloudera Manager imports the cluster template.
Ensure that the values, such as the {{{esa_address}}} should be written as it is (called Mustache template “{{{…}}}”). The actual value is set by adding the custom properties during the creation of the CDP data hub cluster. For more information about the format of the custom properties, check thecustom_properties_template.jsonfile in the S3 bucket containing installation files of Big Data Protector. - After adding the bdp_pep service object, search for the
hostTemplateskey in the cluster template, whose value is an array ofhostTemplateobjects for master, worker, and compute nodes etc. - For each hostTemplate in that array, search for the key
roleConfigGroupsRefNames, which has a value of array of strings. - Add the
bdp_pep-PTY_RPAGENT-BASEand thebdp_pep-PTY_LOGFORWARDER-BASEstrings in theroleConfigGroupsRefNamesarray.{ ... "hostTemplates": [ { "refName": "...", "cardinality" : ..., "roleConfigGroupsRefNames": [ ..., "bdp_pep-PTY_RPAGENT-BASE", "bdp_pep-PTY_LOGFORWARDER-BASE" ], ... }, { ... }, ... ] ... } - Click Register.
Feedback
Was this page helpful?