Enhanced control over pipeline execution identity.
This update allows users to set a run-as identity for Spark Declarative Pipelines, enabling the use of service principals instead of user accounts for executing pipeline updates and managing table ownership. This feature enhances security and reliability, especially when the original pipeline owner is no longer available. Users can configure this setting through the pipeline monitoring page or editor, ensuring that the pipeline continues to function seamlessly.
By allowing the use of service principals as run-as identities, organizations can improve the security and stability of their automated workloads. This change mitigates risks associated with user account deactivation and ensures that pipelines remain operational, which is crucial for maintaining data accessibility and governance. It also aligns with best practices for managing automated processes in a cloud environment.