Understanding the architecture

• 1: For the Application Protector REST Approach
• 2: For the Cloud Protector Approach

1 - For the Application Protector REST Approach

The architecture for installing the Azure Databricks protector using the Application Protector REST approach is depicted in the image below.

An outline of the steps in the workflow is explained below.

1. Download the Azure Databricks build from the customer portal and extract the configurator script.
2. Execute the configurator script to retrieve the IP address of the Application Protector REST server.
3. Use the IP address to generate the CA, client, and server certificates.
4. Store the content of the CA and the client certificates in the Azure Key Vault.
5. Create a Databricks Unity Catalog Service Credentials to access the Secrets from the Azure Key Vault.
6. Execute the configurator script to create the Unity Catalog Batch Python UDFs.
7. Edit the cluster configuration to include the environment variables and attach the initialization script.

2 - For the Cloud Protector Approach

The architecture for installing the Azure Databricks protector using the Cloud Protector approach is depicted in the image below.

An outline of the steps in the workflow is explained below.

1. Install and configure the Cloud Protector.
2. Store the Cloud Protector’s default host key into an Azure Key Vault Secret with name as PTY-CLOUD-PROTECTOR-DEFAULT-HOST-KEY.
3. Create an Azure Managed Identity and connect it with the Azure Key Vault Secret.
4. Create an Azure Databricks Unity Catalog Service Credential and connect it with the Azure Managed Identity.
5. Create either of a Dedicated Compute, Standard Compute, and SQL Warehouse.
6. Download and extract the installation package on a Linux instance having connectivity to PPC.
7. Execute the configurator script to create the Batch Python UDFs at the Unity Catalog level.
8. Attach an Azure Databricks Notebook to the compute.
9. Execute the Unity Catalog Batch Python UDFs to protect data.