Public Preview Azure OpenAI Semantic Caching policy in Azure API Management

We’re excited to announce the Public Preview for the Azure OpenAI Semantic Caching policy in Azure API Management! This innovative feature empowers customers to optimize token usage by leveraging semantic caching, which intelligently stores completions for prompts with similar meanings.
Source: Microsoft Azure – aggiornamenti