databricks Platform · Updated Jul 22, 2026

Automated Setup for S3 External Locations

Streamline the connection of S3 buckets to Databricks with automated provisioning.

What it does

The automated setup for S3 external locations allows users to connect an S3 bucket to Databricks by automatically provisioning necessary AWS resources and Databricks configuration objects. This includes creating an IAM role with a least-privilege access policy, a cross-account trust policy, a storage credential, and an external location registered in Unity Catalog. The process utilizes AWS IAM temporary delegation for secure access and includes built-in approval workflows for AWS admin authorization.

Why it matters

This update simplifies the process of connecting S3 storage to Databricks, reducing the time and complexity involved in manual setups. By automating resource provisioning and ensuring compliance with security best practices, organizations can enhance productivity and minimize risks associated with misconfigurations. This is particularly beneficial for data teams that require quick access to external data sources for analytics and machine learning.

Key capabilities

Automated Resource Provisioning

Automatically provisions IAM roles and storage credentials in AWS for seamless integration.

Built-in Approval Workflows

Includes workflows for AWS admin authorization, streamlining the setup process.

Temporary Delegation Security

Uses AWS IAM temporary delegation to ensure secure and limited access during setup.

Logging and Tracking

All automated actions are logged in AWS CloudTrail for auditing and compliance.

Prerequisites

An existing S3 bucket in your AWS account.

Databricks permissions: Workspace admin, Metastore admin, or specific privileges on the metastore.

Recommended use cases

Quickly connect S3 data sources for analytics.Enable data teams to access external data without complex setups.Facilitate secure data sharing across different AWS accounts.

Limitations · remember

!S3 bucket names cannot use dot notation.

!External location paths must use standard ASCII characters only.

!S3 access control lists (ACLs) must not be enabled on the bucket.

Architecture

Databricks Workspace → Unity Catalog → AWS IAM → S3 Bucket

Get started

Access Catalog

In the sidebar, click Catalog.

Create External Location

Click Connect > External locations and select Create external location.

Select Automated Setup

Choose Set up Automatically and enter the external location name and S3 bucket URL.

Log into AWS

Log into AWS to verify permissions and approve the delegation request.

Confirm Provisioning

Review and confirm the resources to be created in your AWS account.

Key takeaway

The automated setup for S3 external locations simplifies and secures the integration of S3 storage with Databricks.

2026-07-22-automated-setup-for-s3-external-locations Generated by the Databricks Updates Agent · browse all updates