Migration from legacy publishing mode to default publishing mode is now generally available.
The migration allows Spark Declarative Pipelines on Lakeflow to transition from a legacy publishing mode, which restricted publishing to a single catalog and schema, to a default publishing mode that supports multiple catalogs and schemas. This new mode simplifies syntax for table and view management within pipelines and is designed to enhance flexibility and usability. The migration process affects only the metadata of the pipeline and does not impact existing datasets.
This update significantly enhances the capabilities of data teams by allowing them to manage multiple catalogs and schemas within a single pipeline, improving operational efficiency and reducing complexity. It enables better data governance and organization, which can lead to increased productivity and reduced costs associated with data management. Organizations can leverage this feature to streamline their data workflows and improve collaboration across teams.