For serverless compute and classic compute running Databricks Runtime 18 and above, common file access patterns are now detected for workspace files, and directory metadata and file contents are…
For serverless compute and classic compute running Databricks Runtime 18 and above, common file access patterns are now detected for workspace files, and directory metadata and file contents are prefetched in the background. Workloads that read many files, such as find, grep, Python imports, and Git operations, run much faster. Workspace files are the files stored and managed in the Databricks workspace file system.
Workloads that read many files, such as find, grep, Python imports, and Git operations, run much faster.
For serverless compute and classic compute running Databricks Runtime 18 and above, common file access patterns are now detected for workspace files, and directory metadata and file contents are prefetched in the background. Workloads that read many files…
Read the full documentation ↗