Model Serving CPU and GPU workloads, Foundation Model API provisioned throughput endpoints (excluding LLaMA 4), Mosaic AI Gateway, and external models are now available in FIPS compliant environments.
Model Serving CPU and GPU workloads, Foundation Model API provisioned throughput endpoints (excluding LLaMA 4), Mosaic AI Gateway, and external models are now available in FIPS compliant environments. This includes support for the following compliance standards offered through the compliance security profile: FedRAMP Moderate IRAP Canada Protected B See Compliance security profile standards: CPU and GPU workloads for region availability of these standards. This article summarizes the limitations and region availability for Databricks Model Serving and supported endpoint types.
Resource and payload limits Model Serving imposes default limits to ensure reliable performance.
Model Serving CPU and GPU workloads, Foundation Model API provisioned throughput endpoints (excluding LLaMA 4), Mosaic AI Gateway, and external models are now available in FIPS compliant environments. This includes support for the following compliance…
Read the full documentation ↗