← All updates Databricks Update One-Pager Navy version
databricks Platform · Updated Dec 10, 2025

Discover files in Auto Loader efficiently using file events

Auto Loader with file events is now GA.

Update Open docs ↗release note ↗
What it does

Auto Loader with file events is now GA. With this feature, Auto Loader can discover files with the efficiency of notifications while retaining the setup simplicity of directory listing. This is the recommended way to use Auto Loader (and particularly file notifications) with Unity Catalog.

Why it matters

You can use file notifications to scale Auto Loader to ingest millions of files an hour.

Key capabilities
Databricks can set up subscriptions
Databricks can set up subscriptions and file events in your cloud storage account for you without requiring that you supply…
You have fewer IAM role
You have fewer IAM role policies to create in your cloud storage account.
Because you no longer need
Because you no longer need to create a queue for each Auto Loader stream, it's easier to avoid hitting the cloud provider…
Databricks automatically manages the tuning
Databricks automatically manages the tuning of resource requirements, so you don't need to tune parameters such as…
Architecture
Databricks Platform → Platform
In short

Auto Loader with file events is now GA. With this feature, Auto Loader can discover files with the efficiency of notifications while retaining the setup simplicity of directory listing.

Read the full documentation ↗
Key takeaway
Auto Loader with file events is now GA.
2025-12-10-discover-files-in-auto-loader-efficiently-using-file-events Generated by the Databricks Updates Agent · browse all updates