Skip to content

Use Databricks Free Edition

Databricks Free Edition is suitable for learning and limited integration tests. It is not equivalent to a full enterprise Databricks account.

Because Databricks capabilities and quotas can change, review the current Free Edition documentation and limitations before testing.

What to test

Free Edition can be useful for:

  • PAT-based workspace connectivity;
  • catalog and schema discovery;
  • catalog and schema creation when your workspace permits it;
  • default-storage catalog creation through a SQL warehouse;
  • Unity Catalog grants supported by the workspace;
  • import discovery and YAML generation.

Do not rely on Free Edition for:

  • multi-workspace orchestration;
  • account-console administration;
  • enterprise SSO, SCIM, or networking;
  • production scale, quotas, or service commitments.

Configure the provider

provider:
  cloud: azure
  execution_mode: live-readonly
  host: https://your-workspace.cloud.databricks.com
  auth_type: pat
  token_env: DATABRICKS_TOKEN
  sql_warehouse_id_env: DATABRICKS_SQL_WAREHOUSE_ID

The hostname can contain cloud.databricks.com even when the provider cloud is Azure. Use the actual workspace URL shown by Databricks.

Test in stages

1. Validate locally

datamuru validate --config datamuru.yml

2. Verify read-only connectivity

datamuru doctor --config datamuru.yml
datamuru import discover --config datamuru.yml

3. Create a unique test catalog

Switch to live-apply and use a name that cannot collide with important resources:

catalogs:
  - name: dm_free_tutorial_01
    use_default_storage: true
    schemas:
      - bronze
      - silver
datamuru plan --target catalog:dm_free_tutorial_01
datamuru apply --target catalog:dm_free_tutorial_01 --auto-approve
datamuru plan --target catalog:dm_free_tutorial_01

Understand default storage

The Unity Catalog REST API can reject catalog creation when the metastore has no storage root. use_default_storage: true makes DataMuru submit CREATE CATALOG through a configured SQL warehouse, allowing Databricks to select account default storage where available.

Identity limitation

Use existing users and groups for ACL assignments. Managed identity lifecycle is an Enterprise feature and requires account SCIM capability. DataMuru probes capability when managed identities are declared; edition configuration alone cannot create an unavailable Databricks API.

Clean up

Confirm that the catalog contains no needed data, then:

datamuru destroy --target catalog:dm_free_tutorial_01 --confirm-destroy