The Lakeflow Spark Declarative Pipelines sink API is now generally available.
The Lakeflow Spark Declarative Pipelines sink API is now generally available. Use sinks with append flows to write transformed pipeline data to external targets, including Delta tables, Apache Kafka topics, Azure Event Hubs, and custom Python data sources. Use the Lakeflow Spark Declarative Pipelines sink API with flows to write records transformed by a pipeline to an external data sink.
Reduces operational overhead and unlocks new capabilities for data teams on Databricks.
The Lakeflow Spark Declarative Pipelines sink API is now generally available. Use sinks with append flows to write transformed pipeline data to external targets, including Delta tables, Apache Kafka topics, Azure Event Hubs, and custom Python data sources.
Read the full documentation ↗