Combined Generative AI Controller release notes for upgrades from Washington DC to Australia

Consolidated page of all release notes for Generative AI Controller from Washington DC to Australia.

How to use this page

To help you prepare for your upgrade, we have combined the cross-family Generative AI Controller release notes onto one page. Read this summary of the new features, changes, and updated information for your product from Washington DC to Australia.

Tip: If there were no updates for a release notes section in a certain family release, we included a short note for your reference. For example, if a product did not have any updates in Tokyo, the row says “No updates for this release.”

Important information for upgrading Generative AI Controller to Australia

Before you upgrade to Australia, review these pre- and post-upgrade tasks and complete the tasks as needed.

<table class=“custom-rows”><thead><tr><th class=“filter”>

Release

</th><th>

Release notes

</th></tr></thead><tbody><tr><td>

Washington DC

</td><td>

No updates for this release.

</td></tr><tr><td>

Xanadu

</td><td>

No updates for this release.

</td></tr><tr><td>

Yokohama

</td><td>

Generative AI Controller is installed and updated when you install or update any Now Assist application. If you have issues installing or updating applications, see this knowledge article for steps that may address your issue. Otherwise, you can make a Support case.

</td></tr><tr><td>

Zurich

</td><td>

Generative AI Controller is installed or updated when you install or update a Now Assist application. If you have issues installing or updating applications, see this knowledge article or open a support case.

</td></tr><tr><td>

Australia

</td><td>

Generative AI Controller is installed or updated when you install or update a Now Assist application. If you have issues installing or updating applications, see this knowledge article or open a support case.

</td></tr></tbody> </table>## New features

Between your current release family and Australia, new features were introduced for Generative AI Controller.

<table class=“custom-rows”><thead><tr><th class=“filter”>

Release

</th><th>

Release notes

</th></tr></thead><tbody><tr><td>

Washington DC

</td><td>

• Recursive summarization for large inputs

Large language models (LLMs) have a maximum number of tokens per request. Recursive summarization breaks down large inputs into smaller pieces, summarizes those pieces, and then recombines them to make the original call. This process prevents important context from being lost when submitting requests to the LLM, which can result in more accurate responses with fewer hallucinations.

• Integrate with Aleph Alpha models

Bring your own API credentials and connect Aleph Alpha’s Luminous LLM with the ServiceNow AI Platform.

• Integrate with IBM watsonx models

Use your own API credentials to connect to IBM watsonx’s Granite LLMs with the ServiceNow AI Platform.

• Integrate with external LLMs

Connect API credentials with a generic LLM connector and use an external LLM on the ServiceNow AI Platform.

• Semantic filter for sensitive content in generative AI conversations

Use AI Semantic Search to help determine if sensitive content is being discussed, such as workplace misconduct or employee health concerns, and trigger a switch to a different Virtual Agent topic.

• Disable Dynamic Translation for LLM conversations in Virtual Agent

Dynamic Translation is enabled by default for ServiceNow AI Platform feature that is available with activation of any Now Assist applications, but you can disable it if you prefer not to have multi-language support for LLM conversations.

</td></tr><tr><td>

Xanadu

</td><td>

• Metadata log table for generative AI requests

Use the new metadata log table that includes information about the requesting conversation, the capability definition, provided feedback (if any), and error codes.

• Translation for Now Assist

Support users who speak different languages with new language information in LLM request metadata, better controls for Dynamic Translation, and translated text logging.

• Global Model selection for conversational skills

Enable Now Assist Admins to choose between GPT4.o and Now Assist LLM model for data routing at a global level. This ensures compliance with any regional restrictions and helpful for APAC users who may face limitations with US-based models, such as GPT-4.0.

</td></tr><tr><td>

Yokohama

</td><td>

• [Placeholder link text to key configure-custom-resource-path-byok]

Connect Generative AI Controller to your Azure OpenAI deployment by configuring a custom resource path in your bring your own key (BYOK) model configuration. Use this when your Azure OpenAI endpoint includes a path segment that Generative AI Controller does not add by default.

• Administrator access to Gen AI log

Access the Gen AI log [sys_generative_ai_log] table to gain insights for debugging purposes. Records related to HR remain restricted to HR admins.

• Enhanced AI asset inventory

Track the enhanced AI asset inventory through AI Control Tower using new metadata fields in the Model [sys_generative_ai_model_config] and Prompt [sys_generative_ai_config] tables. Gain better visibility into AI asset status and life-cycle details, such as retirement dates.

• AI Model Version Mappings

Review the mappings between AI model versions, their providers in the Gen AI Model Version Mapping [sys_gen_ai_model_version_mapping] table. It shows mapping between source and target models, along with associated metadata, such as skill type, model type, resource associations, and provider information.

• Identify third-party LLM information

Access the Gen AI Log Metadata [sys_gen_ai_log_metadata] table to identify which LLM model, version, and requested language was used to generate the AI content.

• Restrict LLM usage based on the domain

Enable or disable Now Assist for each domain so that you can restrict the use of LLMs and avoid using AI for data processing, if needed.

• Global Model selection for conversational skills

Enable Now Assist Admins to choose between GPT4.o and Now Assist LLM model for data routing at a global level. This ensures compliance with any regional restrictions and helpful for APAC users who may face limitations with US-based models, such as GPT-4.0.

</td></tr><tr><td>

Zurich

</td><td>

• Configure a custom resource path for BYOK models

Connect Generative AI Controller to your Azure OpenAI deployment by configuring a custom resource path in your bring your own key (BYOK) model configuration. Use this when your Azure OpenAI endpoint includes a path segment that Generative AI Controller does not add by default.

• Administrator access to Gen AI log

Access the Gen AI log [sys_generative_ai_log] table to gain insights for debugging purposes. HR-related records remain restricted to HR admins.

• Enhanced AI asset inventory

Track the enhanced AI asset inventory through AI Control Tower using new metadata fields in the Model [sys_generative_ai_model_config] and Prompt [sys_generative_ai_config] tables. Gain better visibility into AI asset status and life-cycle details, such as retirement dates.

• Long-Term Stable model for generative AI

Promote stability and adoption for entitled users with a Long-Term Stable (LTS) model. The LTS model provides regulatory alignment, predictable behavior, and life cycle stability to integrate GenAI with confidence.

• AI Model Version Mappings

Review the mappings between AI model versions and their providers in the Gen AI Model Version Mapping [sys_gen_ai_model_version_mapping] table. This table shows the mappings between source and target models, along with associated metadata, such as skill type, model type, resource associations, and provider information.

• Identify third-party LLM information

Access the Gen AI Log Metadata [sys_gen_ai_log_metadata] table to identify which LLM model, version, and requested language was used to generate the AI content.

• Restrict LLM usage based on the domain

Enable or disable Now Assist for each domain so that you can restrict the use of LLMs and avoid using AI for data processing, if needed.

</td></tr><tr><td>

Australia

</td><td>

• Configure a custom resource path for BYOK models

Connect Generative AI Controller to your Azure OpenAI deployment by configuring a custom resource path in your bring your own key (BYOK) model configuration. Use this when your Azure OpenAI endpoint includes a path segment that Generative AI Controller does not add by default.

• ServiceNow product tiers

The ServiceNow AI Platform now brings you a new AI experience with three licensing tiers available:

-   Foundation: AI basics to deliver insights
-   Advanced: AI to boost productivity across relevant use cases
-   Prime: Act autonomously with all AI assets, and create your own

Depending on your license, you will have access to certain application features, generative AI skills, agentic workflows, and AI agents.

</td></tr></tbody> </table>## Changes

Between your current release family and Australia, some changes were made to existing Generative AI Controller features.

<table class=“custom-rows”><thead><tr><th class=“filter”>

Release

</th><th>

Release notes

</th></tr></thead><tbody><tr><td>

Washington DC

</td><td>

No updates for this release.

</td></tr><tr><td>

Xanadu

</td><td>

• Directions for generative AI updates for Generative AI Controller

The prompts, which are the instructions to the large language model (LLM), for all four capabilities (Generic Prompt, Generate Content, Summarization, and Sentiment Analysis), semantic filtering, and recursive summarization have been updated.

</td></tr><tr><td>

Yokohama

</td><td>

• Changes to Now Assist usage measurement

Starting with Yokohama Patch 5, Now Assist usage measurement is transitioning from a 365-day look-back model to a 365-day burn-down model, with usage resetting at the contract anniversary date. For more information, refer to KB KB2704710: Now Assist Usage - Overview & New Measurement Logic.

• Some Now Assist skills are turned on by default

The new default behavior works as follows:

-   New customers: When you install a Now Assist product, designated skills are turned on automatically.
-   Existing customers who are upgrading \(starting with Yokohama Patch 11\): Any previously unconfigured skill is turned on automatically \(the skill was never configured and turned on, then turned off again\). Previously configured skills that were turned on, then off, remain inactive.

• ****

• Configure Data Privacy and Data Discovery to protect the personally identifying information (PII) of your users.

Generative AI Controller has changed to use the Data Privacy application instead of the Sensitive Data Handler to help anonymize PII. The process for choosing what gets anonymized and how has shifted to different tables and forms that your administrator must configure for your organization.

</td></tr><tr><td>

Zurich

</td><td>

• Changes to Now Assist usage measurement

Starting with Zurich Patch 5, Now Assist usage measurement is transitioning from a 365-day look-back model to a 365-day burn-down model, with usage resetting at the contract anniversary date. For more information, refer to KB KB2704710: Now Assist Usage - Overview & New Measurement Logic.

• Direct action calls removed from Generative AI Controller

Starting with Zurich Patch 5, the Generative AI Controller (GAIC) no longer supports direct action calls in order to support the security requirements that all AI capabilities be protected by Access Control Lists (ACLs). To create custom generative AI functionality, use Now Assist Skill Kit instead.

-   Configure actions in the Generative AI Controller
-   Generate Content to create AI-generated text responses
-   QnA to answer user questions
-   Summarize to shorten long or complex text
-   Generic Prompt to generate ideas or content on any topic
-   Sentiment Analysis to identify the sentiment of user input

For more information, refer to KB KB2716977: Generative AI Controller actions are no longer avaliable for custom workflows.

</td></tr><tr><td>

Australia

</td><td>

No updates for this release.

</td></tr></tbody> </table>## Removed

Between your current release family and Australia, some Generative AI Controller features or functionality were removed.

<table class=“custom-rows”><thead><tr><th class=“filter”>

Release

</th><th>

Release notes

</th></tr></thead><tbody><tr><td>

Washington DC

</td><td>

• The QnA capability has been removed and the action has been removed from Virtual Agent Designer and Workflow Studio.

</td></tr><tr><td>

Xanadu

</td><td>

No updates for this release.

</td></tr><tr><td>

Yokohama

</td><td>

No updates for this release.

</td></tr><tr><td>

Zurich

</td><td>

No updates for this release.

</td></tr><tr><td>

Australia

</td><td>

No updates for this release.

</td></tr></tbody> </table>## Deprecations

Between your current release family and Australia, some Generative AI Controller features or functionality were deprecated.

<table class=“custom-rows”><thead><tr><th class=“filter”>

Release

</th><th>

Release notes

</th></tr></thead><tbody><tr><td>

Washington DC

</td><td>

No updates for this release.

</td></tr><tr><td>

Xanadu

</td><td>

No updates for this release.

</td></tr><tr><td>

Yokohama

</td><td>

The dependency on Sensitive Data Handler has been removed. Regular expressions that are configured with Sensitive Data Handler are applied to the Data Privacy application with a fix script when you upgrade to Yokohama.

</td></tr><tr><td>

Zurich

</td><td>

No updates for this release.

</td></tr><tr><td>

Australia

</td><td>

No updates for this release.

</td></tr></tbody> </table>## Activation information

Review information on how to activate Generative AI Controller.

<table class=“custom-rows”><thead><tr><th class=“filter”>

Release

</th><th>

Release notes

</th></tr></thead><tbody><tr><td>

Washington DC

</td><td>

Generative AI Controller is a ServiceNow AI Platform feature that is available with activation of any Now Assist application. For details, see Installing Generative AI Controller.

</td></tr><tr><td>

Xanadu

</td><td>

Generative AI Controller is a ServiceNow AI Platform feature that is available with activation of any ServiceNow® Now Assist application. For details, see Installing Generative AI Controller.

</td></tr><tr><td>

Yokohama

</td><td>

Generative AI Controller is a ServiceNow AI Platform feature that is available with activation of a Now Assist application. For details, see Installing Generative AI Controller and Install Now Assist plugins.

</td></tr><tr><td>

Zurich

</td><td>

Generative AI Controller is a ServiceNow AI Platform feature that is available with activation of a Now Assist application. For details, see Installing Generative AI Controller and Install Now Assist plugins.

</td></tr><tr><td>

Australia

</td><td>

Generative AI Controller is a ServiceNow AI Platform feature that is available with activation of a Now Assist application. For details, see Installing Generative AI Controller and Install Now Assist plugins.

</td></tr></tbody> </table>## Additional requirements

If any additional requirements were introduced or changed for Generative AI Controller we have noted them here.

<table class=“custom-rows”><thead><tr><th class=“filter”>

Release

</th><th>

Release notes

</th></tr></thead><tbody><tr><td>

Washington DC

</td><td>

No updates for this release.

</td></tr><tr><td>

Xanadu

</td><td>

No updates for this release.

</td></tr><tr><td>

Yokohama

</td><td>

No updates for this release.

</td></tr><tr><td>

Zurich

</td><td>

No updates for this release.

</td></tr><tr><td>

Australia

</td><td>

No updates for this release.

</td></tr></tbody> </table>## Browser requirements

If any specific browser requirements were introduced or changed for Generative AI Controller we have noted them here.

<table class=“custom-rows”><thead><tr><th class=“filter”>

Release

</th><th>

Release notes

</th></tr></thead><tbody><tr><td>

Washington DC

</td><td>

No updates for this release.

</td></tr><tr><td>

Xanadu

</td><td>

No updates for this release.

</td></tr><tr><td>

Yokohama

</td><td>

No updates for this release.

</td></tr><tr><td>

Zurich

</td><td>

No updates for this release.

</td></tr><tr><td>

Australia

</td><td>

No updates for this release.

</td></tr></tbody> </table>## Accessibility information

Review details on accessibility information for Generative AI Controller, such as specific requirements or compliance levels.

<table class=“custom-rows”><thead><tr><th class=“filter”>

Release

</th><th>

Release notes

</th></tr></thead><tbody><tr><td>

Washington DC

</td><td>

No updates for this release.

</td></tr><tr><td>

Xanadu

</td><td>

No updates for this release.

</td></tr><tr><td>

Yokohama

</td><td>

No updates for this release.

</td></tr><tr><td>

Zurich

</td><td>

No updates for this release.

</td></tr><tr><td>

Australia

</td><td>

No updates for this release.

</td></tr></tbody> </table>## Localization information

If there are specific localization considerations for Generative AI Controller we have noted them here.

<table class=“custom-rows”><thead><tr><th class=“filter”>

Release

</th><th>

Release notes

</th></tr></thead><tbody><tr><td>

Washington DC

</td><td>

No updates for this release.

</td></tr><tr><td>

Xanadu

</td><td>

Generative AI Controller uses Microsoft Azure OEM for Dynamic Translation in Now Assist for multi-language support. You can enable dynamic translation from the Now Assist Admin console.

</td></tr><tr><td>

Yokohama

</td><td>

No updates for this release.

</td></tr><tr><td>

Zurich

</td><td>

Generative AI Controller uses Microsoft Azure OEM for Dynamic Translation in Now Assist for multilanguage support. You can enable dynamic translation from the Now Assist Admin console. For more information, see Microsoft Azure OEM for Dynamic Translation in Now Assist.

</td></tr><tr><td>

Australia

</td><td>

Generative AI Controller uses Microsoft Azure OEM for Dynamic Translation in Now Assist for multilanguage support. You can enable dynamic translation from the Now Assist Admin console. For more information, see Microsoft Azure OEM for Dynamic Translation in Now Assist.

</td></tr></tbody> </table>## Highlight information

If there are specific highlight considerations for Generative AI Controller we have noted them here.

<table class=“custom-rows”><thead><tr><th class=“filter”>

Release

</th><th>

Release notes

</th></tr></thead><tbody><tr><td>

Washington DC

</td><td>

• Integrate with custom LLMs in generative AI capabilities in Workflow Studio and Virtual Agent Designer

• Add semantic filters in Virtual Agent to detect and handle sensitive topics

See Generative AI Controller for more information.

</td></tr><tr><td>

Xanadu

</td><td>

Xanadu Patch 3

• Review a read-only metadata log table for generative AI requests.

• Use the improved language support for skills and capabilities, including the Dynamic Translation services and native translation by the LLMs.

Xanadu Patch 1

• Updated prompts for capabilities, semantic filtering, and recursive summarization that improve latency and processing for Generative AI Controller capabilities and Now Assist skills.

See Generative AI Controller for more information.

</td></tr><tr><td>

Yokohama

</td><td>

Yokohama Patch 11

• Review changes to Now Assist usage measurement.

• Some Now Assist skills, agents, and agentic workflows are on by default.

• Additional role configuration is required for agentic workflows and AI agents included with Now Assist applications.

Previous Patch releases

• Protect your users by configuring settings for anonymization of personally identifiable information (PII) with the Data Privacy application.

See Generative AI Controller for more information.

</td></tr><tr><td>

Zurich

</td><td>

Zurich Patch 8

• Connect your Azure OpenAI deployment to Generative AI Controller by configuring a custom resource path in your bring your own key (BYOK) model configuration.

Zurich Patch 5

• Review changes to Now Assist usage measurement.

Zurich Patch 4

• Access the Gen AI log for debugging insights, with HR-related records remaining restricted.

• Promote stability with the Long-Term Stable (LTS) model for generative AI.

• Identify third-party LLM information, including model, version, and language.

• Restrict LLM usage based on domain.

See Generative AI Controller for more information.

</td></tr><tr><td>

Australia

</td><td>

Connect your Azure OpenAI deployment to Generative AI Controller by configuring a custom resource path in your bring your own key (BYOK) model configuration.

See Generative AI Controller for more information.

</td></tr></tbody> </table>Parent Topic:Products combined by family