v0.210.0

This release includes the new databricks labs command to install, manage, and run Databricks Labs projects.

CLI:

• Add --debug as shortcut for --log-level debug (#964).
• Improved usability of databricks auth login ... --configure-cluster (#956).
• Make databricks configure save only explicit fields (#973).
• Add databricks labs command group (#914).
• Tolerate missing .databrickscfg file during databricks auth login (#1003).
• Add --configure-cluster flag to configure command (#1005).
• Fix bug where the account or workspace client could be nil (#1020).

Bundles:

• Do not allow empty descriptions for bundle template inputs (#967).
• Added support for top-level permissions (#928).
• Allow jobs to be manually unpaused in development mode (#885).
• Fix template initialization from current working directory (#976).
• Add --tag and --branch options to bundle init command (#975).
• Work around DLT issue with $PYTHONPATH not being set correctly (#999).
• Enable spark_jar_task with local JAR libraries (#993).
• Pass USERPROFILE environment variable to Terraform (#1001).
• Improve error message when path is not a bundle template (#985).
• Correctly overwrite local state if remote state is newer (#1008).
• Add mlops-stacks to the default databricks bundle init prompt (#988).
• Do not add wheel content hash in uploaded Python wheel path (#1015).
• Do not replace pipeline libraries if there are no matches for pattern (#1021).

Internal:

• Update CLI version in the VS Code extension during release (#1014).

API Changes:

• Changed databricks functions create command . New request type is .
• Changed databricks metastores create command with new required argument order.
• Removed databricks metastores enable-optimization command.
• Removed databricks account o-auth-enrollment command group.
• Removed databricks apps delete command.
• Removed databricks apps get command.
• Added databricks apps delete-app command.
• Added databricks apps get-app command.
• Added databricks apps get-app-deployment-status command.
• Added databricks apps get-apps command.
• Added databricks apps get-events command.
• Added databricks account network-connectivity command group.

OpenAPI commit 22f09783eb8a84d52026f856be3b2068f9498db3 (2023-11-23)

Dependency updates:

• Bump golang.org/x/term from 0.13.0 to 0.14.0 (#981).
• Bump github.com/hashicorp/terraform-json from 0.17.1 to 0.18.0 (#979).
• Bump golang.org/x/oauth2 from 0.13.0 to 0.14.0 (#982).
• Bump github.com/databricks/databricks-sdk-go from 0.24.0 to 0.25.0 (#980).
• Bump github.com/databricks/databricks-sdk-go from 0.25.0 to 0.26.0 (#1019).

v0.209.1

CLI:

• Hide --progress-format global flag (#965).
• Make configure command visible + fix bundle command description (#961).
• Log process ID in each log entry (#949).
• Improve error message when --json flag is specified (#933).

Bundles:

• Remove validation for default value against pattern (#959).
• Bundle path rewrites for dbt and SQL file tasks (#962).
• Initialize variable definitions that are defined without properties (#966).

Internal:

• Function to merge two instances of config.Value (#938).
• Make to/from string methods private to the jsonschema package (#942).
• Make Cobra runner compatible with testing interactive flows (#957).
• Added env.UserHomeDir(ctx) for parallel-friendly tests (#955).

Dependency updates:

• Bump golang.org/x/mod from 0.13.0 to 0.14.0 (#954).
• Bump golang.org/x/text from 0.13.0 to 0.14.0 (#953).
• Bump golang.org/x/sync from 0.4.0 to 0.5.0 (#951).
• Bump github.com/spf13/cobra from 1.7.0 to 1.8.0 (#950).
• Bump github.com/fatih/color from 1.15.0 to 1.16.0 (#952).

v0.209.0

CLI:

• Added GitHub issue templates for CLI and DABs issues (#925).
• Simplified code generation logic for handling path and request body parameters and JSON input (#905).

Bundles:

• Fixed URL for bundle template documentation in init command help docs (#903).
• Fixed pattern validation for input parameters in a bundle template (#912).
• Fixed multiline description rendering for enum input parameters in bundle templates (#916).
• Changed production mode check for whether identity used is a service principal to use UserName (#924).
• Changed bundle deploy to upload partial terraform state even if deployment fails (#923).
• Added support for welcome messages to bundle templates (#907).
• Added support for uploading bundle deployment metadata to WSFS (#845).

Internal:

• Loading an empty yaml file yields a nil (#906).
• Library to convert config.Value to Go struct (#904).
• Remove default resolution of repo names against the Databricks Github account(#940).
• Run make fmt from fmt job (#929).
• make snapshot to build file in .databricks/databricks (#927).
• Add configuration normalization code (#915).

API Changes:

• Added databricks account network-policy command group.

Dependency updates:

• Bump Terraform provider from v1.28.0 to v1.29.0 (#926).
• Bump the Go SDK in the CLI from v0.23 to v0.24 (#919).
• Bump google.golang.org/grpc from 1.58.2 to 1.58.3 (#920).
• Bump github.com/google/uuid from 1.3.1 to 1.4.0 (#932).

OpenAPI commit 5903bb39137fd76ac384b2044e425f9c56840e00 (2023-10-23)

v0.208.2

CLI:

• Never load authentication configuration from bundle for sync command (#889).
• Fixed requiring positional arguments for API URL parameters (#878).

Bundles:

• Add support for validating CLI version when loading a jsonschema object (#883).
• Do not emit wheel wrapper error when python_wheel_wrapper setting is true (#894).
• Resolve configuration before performing verification (#890).
• Fix wheel task not working with with 13.x clusters (#898).

Internal:

• Skip prompt on completion hook (#888).
• New YAML loader to support configuration location (#828).

Dependency updates:

• Bump github.com/mattn/go-isatty from 0.0.19 to 0.0.20 (#896).

v0.208.1

CLI:

• Fix rendering of streaming response (#876).

Bundles:

• Rename MLOps Stack to MLOps Stacks (#881).
• Support Python wheels larger than 10MB (#879).
• Improve the output of the databricks bundle init command (#795).

v0.208.0

Note: this release includes a fix for the issue where zero values (for example num_workers: 0) were not included in the request body.

CLI:

• Use already instantiated WorkspaceClient in sync command (#867).

Bundles:

• Support Unity Catalog Registered Models in bundles (#846).
• Fixed merging task libraries from targets (#868).
• Add alias for mlops-stack template URL (#869).

API Changes:

• Changed databricks account billable-usage download command to start returning output.
• Changed databricks account storage-credentials delete command with new required argument order.
• Changed databricks account storage-credentials get command with new required argument order.
• Changed databricks account storage-credentials update command with new required argument order.
• Added databricks workspace-bindings get-bindings command.
• Added databricks workspace-bindings update-bindings command.
• Removed databricks account network-policy command group.
• Changed databricks ip-access-lists list command to return output.

OpenAPI commit 493a76554afd3afdd15dc858773d01643f80352a (2023-10-12)

Dependency updates:

• Update Go SDK to 0.23.0 and use custom marshaller (#772).
• Bump Terraform provider to v1.28.0 (#871).
• Bump golang.org/x/net from 0.16.0 to 0.17.0 (#863).
• Bump github.com/hashicorp/hc-install from 0.6.0 to 0.6.1 (#870).

v0.207.1

CLI:

• Improve workspace import command by allowing references to local files for content (#793).
• Add --file flag to workspace export command (#794).
• Ensure profile flag is respected for sync command (#837).
• Add hint to delete sync snapshot if parsing fails (#853).
• Use profile information when getting a token using the CLI (#855).

Bundles:

• Minor template tweaks (#832).
• Fixed using repo files as pipeline libraries (#847).
• Support .gitignore syntax in sync section and make sure it works recursively (#854).
• Allow target overrides for sync section (#856).

Internal:

• Fix import export integration tests on windows (#842).
• Fix workspace import test (#844).
• Automatically create a release PR in homebrew-tap repo (#841).

Dependency updates:

• Bump golang.org/x/term from 0.12.0 to 0.13.0 (#852).
• Bump golang.org/x/mod from 0.12.0 to 0.13.0 (#851).
• Bump golang.org/x/sync from 0.3.0 to 0.4.0 (#849).
• Bump golang.org/x/oauth2 from 0.12.0 to 0.13.0 (#850).

v0.207.0

CLI:

• Refactor change computation for sync (#785).

Bundles:

• Allow digits in the generated short name (#820).
• Emit an error when incompatible all purpose cluster used with Python wheel tasks (#823).
• Use normalized short name for tag value in development mode (#821).
• Added python.DetectInterpreters and other utils (#805).
• Mark artifacts properties as optional (#834).
• Added support for glob patterns in pipeline libraries section (#833).

Internal:

• Run tests to verify backend tag validation behavior (#814).
• Library to validate and normalize cloud specific tags (#819).
• Added test to submit and run various Python tasks on multiple DBR versions (#806).
• Create a release PR in setup-cli repo on tag push (#827).

API Changes:

• Changed databricks account metastore-assignments list command to return .
• Changed databricks jobs cancel-all-runs command with new required argument order.
• Added databricks account o-auth-published-apps command group.
• Changed databricks serving-endpoints query command . New request type is .
• Added databricks serving-endpoints patch command.
• Added databricks credentials-manager command group.
• Added databricks settings command group.
• Changed databricks clean-rooms list command to require request of .
• Changed databricks statement-execution execute-statement command with new required argument order.

OpenAPI commit bcbf6e851e3d82fd910940910dd31c10c059746c (2023-10-02)
Dependency updates:

• Bump github.com/google/uuid from 1.3.0 to 1.3.1 (#825).
• Updated Go SDK to 0.22.0 (#831).

v0.206.0

Bundles:

• Enable target overrides for pipeline clusters (#792).
• Add support for regex patterns in template schema (#768).
• Make the default databricks bundle init template more self-explanatory (#796).
• Make a notebook wrapper for Python wheel tasks optional (#797).
• Added a warning when Python wheel wrapper needs to be used (#807).

Internal:

• Added process.Background() and process.Forwarded() (#804).

Dependency updates:

• Bump golang.org/x/term from 0.11.0 to 0.12.0 (#798).
• Bump github.com/hashicorp/terraform-exec from 0.18.1 to 0.19.0 (#801).
• Bump golang.org/x/oauth2 from 0.11.0 to 0.12.0 (#802).

v0.205.2

CLI:

• Prompt for profile only in interactive mode (#788).

Internal:

• Added setup Python action (#789).