DataBricks - Troubleshooting

While configuring your DataBricks connection, you may encounter several issues. Understanding these common errors can help streamline the setup process and facilitate quick resolutions.

Wrong input data

• wrong/invalid server hostname
• firewall issue

Error message:

General solution

Hostname Verification:

• Confirm the hostname is entered correctly in your DataBricks connection settings.

Firewall Configuration:

• Ensure your firewall has whitelisted the necessary IP addresses for DataBricks access.
• Set "Use static IP = YES" in the DataBricks connection parameters to maintain a consistent IP address during connections.

Refer to the documentation if necessary.

Token issues

• Wrong Databricks access token
• Token without write permission
• Token without delete permission
• Filepath to a forbidden directory

Error message:

Solution

Access Token Validation:

• Double-check the access token for correctness. Tokens must be exact, with no errors in character entry.

Ensure Adequate Permissions:

• Verify that the token permissions include WRITE and DELETE capabilities required for DataBricks operations.

Test Token Functionality:

• After validation and permission checks, perform a test run to ensure the token works as expected for operations in DataBricks.

Wrong permissions

Error message:

Solution

Grant MODIFY Privileges:

• You need to assign MODIFY permissions to the Databricks user on the table in question. To do this, use the GRANT SQL command to allow the necessary privileges:
  GRANT MODIFY ON TABLE uc_analytics_stage.de_advantage.im_test_table_check_connection TO <user>.
• For further details, you can check the Databricks GRANT documentation in Microsoft Learn or in the Databricks documentation.

Ensure Correct Role and Permissions:

• Double-check that the user has the correct role and permissions to manage this table. In Unity Catalog, privileges may also need to be inherited from a higher-level securable object (like a schema or catalog), depending on your organization's setup. More on this can be found in the Unity Catalog Privileges documentation.
• Once these permissions are granted, re-authorize the connection in the Improvado interface.

‍