The Databricks hosted foundation models, OpenAI GPT OSS 120B and GPT OSS 20B are now supported on Provisioned throughput Foundation Model APIs.
The Databricks hosted foundation models, OpenAI GPT OSS 120B and GPT OSS 20B are now supported on Provisioned throughput Foundation Model APIs. This article demonstrates how to deploy models using Foundation Model APIs provisioned throughput. Databricks recommends provisioned throughput for production workloads, and it provides optimized inference for foundation models with performance guarantees.
Databricks recommends provisioned throughput for production workloads, and it provides optimized inference for foundation models with performance guarantees.
The Databricks hosted foundation models, OpenAI GPT OSS 120B and GPT OSS 20B are now supported on Provisioned throughput Foundation Model APIs. This article demonstrates how to deploy models using Foundation Model APIs provisioned throughput.
Read the full documentation ↗