Tasks that wait on child processes (Run job and For each tasks) now have a separate limit for the number of tasks that can run simultaneously, and do not count against the overall limit.
Tasks that wait on child processes (Run job and For each tasks) now have a separate limit for the number of tasks that can run simultaneously, and do not count against the overall limit. The following tables list various numerical limits for Databricks resources. For additional information about Databricks resource limits, see each individual resource's overview documentation.
Reduces operational overhead and unlocks new capabilities for data teams on Databricks.
Tasks that wait on child processes (Run job and For each tasks) now have a separate limit for the number of tasks that can run simultaneously, and do not count against the overall limit. The following tables list various numerical limits for Databricks…
Read the full documentation ↗