You can now add data quality expectations to materialized views created in Databricks SQL using the CONSTRAINT expectation name EXPECT (expectation expr) clause.
You can now add data quality expectations to materialized views created in Databricks SQL using the CONSTRAINT expectation name EXPECT (expectation expr) clause. Expectations let you validate records as they flow through the standalone pipeline that backs the materialized view, and warn, drop, or fail on records that violate a constraint. Streaming tables created in Databricks SQL already support expectations.
Reduces operational overhead and unlocks new capabilities for data teams on Databricks.
You can now add data quality expectations to materialized views created in Databricks SQL using the CONSTRAINT expectation name EXPECT (expectation expr) clause. Expectations let you validate records as they flow through the standalone pipeline that backs…
Read the full documentation ↗