The ai prep search() SQL function now accepts plain text and markdown STRING content in addition to the structured VARIANT output of ai parse document.
The ai prep search() SQL function now accepts plain text and markdown STRING content in addition to the structured VARIANT output of ai parse document. You can now chunk and prepare text that you already have as a string for AI Search indexing and retrieval augmented generation (RAG) pipelines, without first running it through document parsing. Applies to: Databricks SQL Databricks Runtime Beta This feature is in Beta.
Databricks might upgrade the supported or default version to reflect improved representations based on ongoing research.
The ai prep search() SQL function now accepts plain text and markdown STRING content in addition to the structured VARIANT output of ai parse document. You can now chunk and prepare text that you already have as a string for AI Search indexing and retrieval…
Read the full documentation ↗