Migration from legacy publishing mode to default mode is now generally available.
The migration from the legacy publishing mode to the default publishing mode allows Spark Declarative Pipelines to publish to multiple catalogs and schemas instead of being limited to a single catalog and schema. The default mode features a simplified syntax for managing tables and views, enhancing usability. Migration only affects the metadata of the pipeline and does not involve any data movement or dataset modifications. The legacy mode is deprecated, and users are encouraged to transition to the default mode for improved functionality.
This update significantly enhances the flexibility and scalability of data pipelines, allowing organizations to manage their data more effectively across multiple catalogs and schemas. By simplifying the publishing process, teams can increase productivity and reduce the complexity of their data workflows. The transition to the default mode also aligns with best practices, ensuring that users benefit from the latest features and optimizations.