Enhanced throughput for compliance workspaces.
AI Search high QPS will be enabled by default for workspaces with the compliance security profile, allowing users to set a target queries per second (QPS) on standard AI Search endpoints. This feature supports high-throughput, real-time applications such as search bars and recommendation systems, with the ability to provision additional capacity as needed. However, the actual throughput is best-effort and not guaranteed, depending on various factors like index size and query complexity.
This update significantly enhances the performance of real-time applications, enabling businesses to handle higher query loads without degradation in service. Organizations that rely on search and recommendation functionalities will benefit from improved responsiveness and user experience, potentially leading to increased customer satisfaction and engagement. Additionally, it allows for better resource management and cost control by enabling targeted scaling based on actual needs.