databricks Platform · Updated May 29, 2026

Databricks Runtime 18: May 29, 2026

What it does

Structured Streaming deduplication with NaN keys: Structured Streaming deduplication now treats NaN (Not a Number) values that have different bit patterns as duplicates when a double or float column is used as a deduplication key. Previously, NaN values with different internal representations were treated as distinct and were not deduplicated. Fixed an issue where table level permissions could be removed from Unity Catalog foreign catalog tables (for example, Snowflake connection tables) during metadata refresh, which caused queries to fail with INSUFFICIENT PERMISSIONS errors.

Why it matters

+ Trigger intervals + Set trigger intervals to balance latency and cost for your processing requirements.

Key capabilities

Auto Loader

Incrementally and efficiently process new

Incrementally and efficiently process new data files as they arrive in cloud storage.

Delta Lake table streaming reads

Delta Lake table streaming reads and writes

Use Delta Lake tables as

Use Delta Lake tables as streaming sources and sinks with exactly-once processing guarantees.

Architecture

Databricks Platform → Platform

In short

Read the full documentation ↗

Key takeaway

2026-05-29-databricks-runtime-18-may-29-2026 Generated by the Databricks Updates Agent · browse all updates