Automated testing for Virtual Agent topics that use NLU topic discovery

Automated testing for your Virtual Agent topic flows uses the ServiceNow Automated Test Framework product through Assistant Designer. You can create and run automated tests through the Automated Test Framework to confirm that your topic flow works after making a change.

Create topic test cases through a topic’s Test > Create test case preview and view the topic’s test cases through the Asset library’s Manage NLU/keyword test cases button. Only run automated tests on a development, test, or other non-production instance to avoid data corruption and outage. For more information, see the Automated Test Framework.

Working with test cases is only available if you have:

• Installed the com.glide.cs.atf plugin (installed as a part of the Virtual Agent chatbot plugin).

• Received one of the following roles: atf_test_designer, atf_ws_designer, atf_test_admin, virtual_agent_admin, or admin.

• Published topics with one of the following topic types: Topic, Setup Topic, or Small talk.

• Create an automated test in Assistant Designer Asset library
  Create automated tests in Assistant Designer Asset library, and run tests regularly against ideal conversation topic flows. You can create multiple automated tests for a topic to capture different conversation flows for various situations such as ideal conversation paths or errors.

• Manage and run automated test cases in Assistant Designer Asset library
  Run reusable test cases of your published topics using the Automated Test Framework through Assistant Designer Asset library to identify performance issues and prevent regressions before production.

• Handle failures caused by dynamic inputs in user testing of Virtual Agent topics
  Avoid failures when performing automated tests for topics in Assistant Designer by controlling which inputs that you want to run as part of a test case.

Parent Topic:Testing NLU/Keyword topics