← All updates Databricks Update One-Pager Light version
databricks Platform · Updated Oct 23, 2025

Genie benchmark scaling and SQL function support

Increased benchmark limit: The maximum number of benchmarks you can add to a Genie Space has been raised from 100 to 500.

Update Open docs ↗release note ↗
What it does

Increased benchmark limit: The maximum number of benchmarks you can add to a Genie Space has been raised from 100 to 500. Run benchmarks selectively: You can now select a subset of benchmark questions to start a run from either the benchmark list page or from a previous benchmark result. Unity Catalog SQL functions as benchmark answers: You can now add Unity Catalog SQL functions as gold standard answers to benchmarks for more comprehensive testing.

Why it matters

Use benchmarks to score response accuracy at scale.

Key capabilities
Click Submit and try again
Click Submit and try again to regenerate the response using the provided feedback.
Click Submit to send the
Click Submit to send the feedback without regenerating the response. Request review: Flags the response for manual review. Users…
Copy CSV: Copy the response
Copy CSV: Copy the response CSV to your clipboard.
Add as instruction: For interactions
Add as instruction: For interactions that might be useful for teaching Genie how to answer similar questions, click Add as…
Architecture
Databricks Platform → Platform
In short

Increased benchmark limit: The maximum number of benchmarks you can add to a Genie Space has been raised from 100 to 500. Run benchmarks selectively: You can now select a subset of benchmark questions to start a run from either the benchmark list page or…

Read the full documentation ↗
Key takeaway
Increased benchmark limit: The maximum number of benchmarks you can add to a Genie Space has been raised from 100 to 500.
2025-10-23-genie-benchmark-scaling-and-sql-function-support Generated by the Databricks Updates Agent · browse all updates