Projects
The project is similar to a map cluster it can be composed of various different Workflows or dags.
Here is an example of an entrypoint. Click the plus buttons to understand all the parts of the entrypoint file.
entrypoint.py
# Databricks notebook source
import examples.brickflow_examples.workflows
from brickflow import Project, PypiTaskLibrary, MavenTaskLibrary
def main() -> None:
"""Project entrypoint"""
with Project(
"brickflow-demo",
git_repo="https://github.com/nike-inc/brickflow",
provider="github",
libraries=[
PypiTaskLibrary(package="networkx"),
],
) as f:
f.add_pkg(examples.brickflow_examples.workflows)
if __name__ == "__main__":
main()