Mosaic AI Model Serving now supports OpenAI's GPT OSS 120B and GPT OSS 20B as Databricks hosted foundation models.
Mosaic AI Model Serving now supports OpenAI's GPT OSS 120B and GPT OSS 20B as Databricks hosted foundation models. You can access these models using Foundation Model APIs pay per token. This article provides an overview of Foundation Model APIs on Databricks.
Provisioned throughput: This mode is recommended for all production workloads, especially those that require high throughput, performance guarantees, fine tuned models, or have additional security requirements.
Mosaic AI Model Serving now supports OpenAI's GPT OSS 120B and GPT OSS 20B as Databricks hosted foundation models. You can access these models using Foundation Model APIs pay per token.
Read the full documentation ↗