Commands
This page provides documentation for our command line tools.
bf¶
CLI for managing Databricks Workflows
Usage:
Options:
bundle¶
CLI for proxying to databricks bundles cli
Usage:
Options:
docs¶
Use to open docs in your browser
Usage:
Options:
projects¶
Manage one to many brickflow projects
Usage:
Options:
add¶
Adds a project to the brickflow-multi-project.yml file and a entrypoint.py file in workflows dir
Usage:
Options:
--name TEXT Name of the project
--path-from-repo-root-to-project-root DIRECTORY
Path from repo root to project root
--path-project-root-to-workflows-dir TEXT
Path from project root to workflows dir
-g, --git-https-url TEXT Provide the github URL for your project,
example: https://github.com/nike-eda-
apla/brickflow
-bfv, --brickflow-version TEXT
-sev, --spark-expectations-version TEXT
--skip-entrypoint Skip creating entrypoint.py file
--help Show this message and exit.
deploy¶
Deploy the resources and workflows to databricks for the project configured in the brickflow-project-root.yml file
Usage:
Options:
--force-acquire-lock Force acquire lock for databricks bundles destroy.
--skip-libraries Skip automatically adding brickflow libraries.
--auto-approve Auto approve brickflow pipeline without being prompted
to approve.
-p, --profile TEXT The databricks profile to use for authenticating to
databricks during deployment.
--project [] Select the project of workflows you would like to
deploy.
-e, --env TEXT Set the environment value, certain tags [TBD] get
added to the workflows based on this value.
--help Show this message and exit.
destroy¶
Destroys the deployed resources and workflows in databricks for the project
Usage:
Options:
--force-acquire-lock Force acquire lock for databricks bundles destroy.
--skip-libraries Skip automatically adding brickflow libraries.
--auto-approve Auto approve brickflow pipeline without being prompted
to approve.
-p, --profile TEXT The databricks profile to use for authenticating to
databricks during deployment.
--project [] Select the project of workflows you would like to
deploy.
-e, --env TEXT Set the environment value, certain tags [TBD] get
added to the workflows based on this value.
--help Show this message and exit.
list¶
Lists all projects in the brickflow-multi-project.yml file
Usage:
Options:
remove¶
Removes a project from the brickflow-multi-project.yml file
Usage:
Options:
sync¶
Sync project file tree into databricks workspace from local. It is only one way from local to databricks workspace.
Usage:
Options:
--watch Enable filewatcher to sync files over.
--full Run a full sync.
--interval-duration TEXT File system polling interval (for --watch).
--debug Enable debug logs
--force-acquire-lock Force acquire lock for databricks bundles destroy.
--skip-libraries Skip automatically adding brickflow libraries.
--auto-approve Auto approve brickflow pipeline without being
prompted to approve.
-p, --profile TEXT The databricks profile to use for authenticating
to databricks during deployment.
--project [] Select the project of workflows you would like to
deploy.
-e, --env TEXT Set the environment value, certain tags [TBD] get
added to the workflows based on this value.
--help Show this message and exit.
synth¶
Synth the bundle.yml for project
Usage:
Options:
--skip-libraries Skip automatically adding brickflow libraries.
-p, --profile TEXT The databricks profile to use for authenticating to
databricks during deployment.
--project [] Select the project of workflows you would like to
deploy.
-e, --env TEXT Set the environment value, certain tags [TBD] get added
to the workflows based on this value.
--help Show this message and exit.