databricks Platform · Updated Jul 14, 2026

Trigger.AvailableNow for OpenSharing Streaming

Enhanced streaming capabilities for OpenSharing tables.

What it does

The `Trigger.AvailableNow` trigger now supports streaming reads from OpenSharing tables, capturing the current version of the shared table and processing all available data across multiple micro-batches. This mechanism allows for scheduled, batch-like incremental processing, adhering to limits set by `maxFilesPerTrigger` and `maxVersionsPerRpc`. This feature is available for users on Databricks Runtime 18.0 or higher.

Why it matters

This update significantly enhances the efficiency of data processing workflows by allowing users to process all available data in a single run, rather than just one micro-batch. This capability is particularly beneficial for organizations that rely on timely data updates for analytics and reporting, ultimately improving productivity and decision-making processes.

Key capabilities

Batch-like Processing

Processes all available data across multiple micro-batches.

Version Capture

Captures the current version of the shared table at the start of processing.

Incremental Updates

Supports scheduled processing for timely data updates.

Runtime Requirement

Requires Databricks Runtime 18.0 or above.

Prerequisites

Databricks Runtime 18.0 or above

Recommended use cases

Scheduled data processing for analyticsIncremental updates for reportingReal-time data integration workflows

Architecture

OpenSharing Source → Streaming Trigger → Databricks Runtime

In short

You can now use a new trigger to efficiently process streaming data from shared tables.

Read the full documentation ↗

Key takeaway

The new `Trigger.AvailableNow` support for OpenSharing streaming enhances data processing efficiency and enables timely analytics.

2026-07-14-trigger-availablenow-support-for-opensharing-streaming-ga Generated by the Databricks Updates Agent · browse all updates