Skip to main content

Setting Up Azure Databricks Private Link

This document provides a step-by-step guide for configuring Azure Private Link for Azure Databricks, ensuring secure connectivity with Chaos Genius to access the Databricks warehouse for querying the database.

Requirements​

Before proceeding, ensure you have:

  • Administrative access to your Azure Account.
  • Azure Databricks workspace with a warehouse deployed in a private VNet.

Configuration Steps​

Step 1: Get the Azure Databricks Workspace Details from Azure Portal​

  1. Sign in to the Azure portal.
  2. Go to Azure Databricks and select the workspace.
  3. Note down the Databricks workspace resource ID and Location details.

Step 2: Provide Azure Databricks Details to Chaos Genius Team​

  1. Share the below details with the Chaos Genius team:
    • Azure Region
    • Azure Databricks Hostname
    • Databricks Workspace Resource ID in this format: /subscriptions/<subscriptionID>/resourceGroups/azure-databricks/providers/Microsoft.Databricks/workspaces/<databricks-workspace>
  2. Ensure that Chaos Genius team has confirmed that the configuration is ready before moving to the next step.

Step 3: Approve the Endpoint Connection Request​

  1. In the Azure Portal, go to Azure Databricks.
  2. Click on selected Azure Databricks workspace.
  3. Click Networking on the left panel.
  4. Click on Private endpoint connections and Review the connection request from Chaos Genius.
  5. Click Approve to allow secure access.

Create Data Source Connection in Chaos Genius​

To connect your Azure Databricks warehouse to Chaos Genius, navigate to Data Sources in the Chaos Genius, select Databricks as your data source, and follow the databricks connection setup guide for setup.

This setup ensures a secure, private, and reliable connection between your Databricks warehouse and Chaos Genius using Azure Private Link.