Environment versions for Lakeflow Spark Declarative Pipelines are now in Beta.
Environment versions for Lakeflow Spark Declarative Pipelines are now in Beta. Configure an environment version on a pipeline to pin the Python language version and set of preinstalled libraries, decoupling your pipeline's Python runtime from Databricks Runtime upgrades. Beta Environment versions for Lakeflow Spark Declarative Pipelines (SDP) are in Beta.
Reduces operational overhead and unlocks new capabilities for data teams on Databricks.
Environment versions for Lakeflow Spark Declarative Pipelines are now in Beta. Configure an environment version on a pipeline to pin the Python language version and set of preinstalled libraries, decoupling your pipeline's Python runtime from Databricks…
Read the full documentation ↗