You can now run a continuous Lakeflow pipeline with a continuous job.
You can now run a continuous Lakeflow pipeline with a continuous job. When a continuous job orchestrates a pipeline, the job determines the execution mode, and the pipeline can use job level features such as serverless Standard performance mode and additional notification destinations. Databricks recommends this pattern over the pipeline's built in continuous setting, which is not being removed.
When a continuous job orchestrates a pipeline, the job determines the execution mode, and the pipeline can use job level features such as serverless Standard performance mode and additional notification destinations.
You can now run a continuous Lakeflow pipeline with a continuous job. When a continuous job orchestrates a pipeline, the job determines the execution mode, and the pipeline can use job level features such as serverless Standard performance mode and…
Read the full documentation ↗