Mosaic AI Model Serving now supports multimodal inputs for Databricks hosted foundation models.
Mosaic AI Model Serving now supports multimodal inputs for Databricks hosted foundation models. This multimodal support is available using the following functionalities: Foundation Model APIs pay per token. Foundation Model APIs provisioned throughput.
| Use AI Functions in production workflows For large scale batch inference, you can integrate task specific AI Functions, or the general purpose function ai query into your production workflows, like Lakeflow Spark Declarative Pipelines, Databricks workflows and Structured Streaming.
Mosaic AI Model Serving now supports multimodal inputs for Databricks hosted foundation models. This multimodal support is available using the following functionalities: Foundation Model APIs pay per token.
Read the full documentation ↗