The object metadata column is now in Public Preview.
The object metadata column is now in Public Preview. The object metadata column is a hidden metadata column that exposes object level properties for objects in cloud storage, including MIME type, ETag, user defined key value metadata, system defined metadata, and object tags. It is available starting from Databricks Runtime 18.1.
Selecting any field from object metadata triggers up to two additional cloud API calls per file, so queries over a large number of small files may experience some latency increase.
The object metadata column is now in Public Preview. The object metadata column is a hidden metadata column that exposes object level properties for objects in cloud storage, including MIME type, ETag, user defined key value metadata, system defined…
Read the full documentation ↗