← All updates Databricks Update One-Pager Light version
databricks Platform · Updated Jan 13, 2026

Row filtering for managed ingestion connectors (Beta)

Lakeflow Connect now offers row filtering for managed ingestion connectors to improve performance and minimize data duplication.

Beta Open docs ↗release note ↗
What it does

Lakeflow Connect now offers row filtering for managed ingestion connectors to improve performance and minimize data duplication. Row filtering applies conditions similar to a SQL WHERE clause, allowing you to ingest only the data you need from your source systems. This feature is available for the Google Analytics, Salesforce, and ServiceNow connectors.

Why it matters

Lakeflow Connect now offers row filtering for managed ingestion connectors to improve performance and minimize data duplication.

Key capabilities
You define a row filter
You define a row filter per source object (table, stream, or object) as a boolean expression over that object's columns.
The filter is applied during
The filter is applied during the initial load and on every subsequent incremental update, so the target stays consistent with…
Because filtering happens before transfer
Because filtering happens before transfer, it reduces data movement, storage, and downstream compute compared with ingesting…
Google Analytics
Google Analytics
Prerequisites
A Lakeflow Connect ingestion pipeline on a supported connector.
Unity Catalog enabled for the destination catalog and schema.
Permission to edit the ingestion pipeline definition.
Recommended use cases
Ingest only rows for a specific region, business unit, or active-record flag.Exclude test or archived records from a SaaS system.Reduce cost and duplication for very large source tables.
Limitations · remember
!Filters reference only columns available on the source object; joins across objects are not supported in a filter.
!Changing a filter after the initial load can require a full refresh of the affected object to remain consistent.
!Non-deterministic source functions are not supported inside a filter.
Architecture
Databricks Platform → Platform
In short

Lakeflow Connect now offers row filtering for managed ingestion connectors to improve performance and minimize data duplication. Row filtering applies conditions similar to a SQL WHERE clause, allowing you to ingest only the data you need from your source…

Read the full documentation ↗
Key takeaway
Lakeflow Connect now offers row filtering for managed ingestion connectors to improve performance and minimize data duplication.
2026-01-13-row-filtering-for-managed-ingestion-connectors-beta Generated by the Databricks Updates Agent · browse all updates