← All updates Databricks Update One-Pager Navy version
databricks Platform · Updated Jun 29, 2026

Custom Docker Images for AI Runtime CLI

Enhance your AI workloads with tailored Docker environments.

What it does

This feature allows users to bring their own Docker container images to AI Runtime CLI workloads, enabling the use of specific system library versions, complex dependencies, and reproducible environments. Users can register public or private Docker images, which are then cached in the Databricks platform for use in workloads. The registration process ensures that the images are ready for execution within 2-6 minutes.

Why it matters

This capability empowers data scientists and engineers to customize their environments, leading to improved reproducibility of research results and the ability to leverage specific dependencies that may not be available in standard images. This flexibility can enhance productivity and reduce the time spent on environment setup, ultimately accelerating the development of AI models.

Key capabilities
Custom Image Registration
Users can register their Docker images with the AI Runtime CLI for use in workloads.
Support for Public and Private Images
Both public and private Docker Hub images can be registered and used.
Environment Variable Injection
AI Runtime injects essential environment variables into containers at runtime.
Use of Databricks Base Images
Users can build custom images based on Databricks-provided base images for optimized performance.
Prerequisites
Install the AI Runtime CLI.
Docker Hub account for private images.
Recommended use cases
Reproducing research results with specific library versions.Using complex dependencies that do not fit standard configurations.Leveraging organizationally built images for compliance and security.Accelerating model development by reducing environment setup time.
Limitations · remember
!Images must be hosted on Docker Hub; other registries are not supported.
!Image size must be under 20 GB.
!WORKDIR is not honored; use absolute paths.
!environment.dependencies and environment.version cannot be used with environment.docker_image.url.
Architecture
User Docker Image → AI Runtime CLI → Databricks Platform → Workload Execution
Get started
1
Install AI Runtime CLI
Ensure the AI Runtime CLI is installed on your system.
2
Register Docker Image
Use 'air register image' command to register your Docker image.
3
Specify Image in Workload
Include the Docker image URL in your workload YAML file.
4
Submit Workload
Run your workload using the 'air run' command.
5
Monitor Execution
Check the execution status and logs for your workload.
Key takeaway
Custom Docker images for AI Runtime CLI workloads provide flexibility and control over the execution environment, enhancing productivity and reproducibility.
2026-06-29-custom-docker-images-for-ai-runtime-cli-workloads-beta Generated by the Databricks Updates Agent · browse all updates