All newly created managed tables in Databricks Runtime 16.0 and above now use Zstandard (Zstd) compression by default instead of Snappy.
All newly created managed tables in Databricks Runtime 16.0 and above now use Zstandard (Zstd) compression by default instead of Snappy. Existing tables continue to use their current compression codec. To change the compression codec for an existing table, set the delta.parquet.compression.codec table property.
This doesn't impact performance because operations against the log are constant time.
All newly created managed tables in Databricks Runtime 16.0 and above now use Zstandard (Zstd) compression by default instead of Snappy. Existing tables continue to use their current compression codec.
Read the full documentation ↗