Baseline Tests

Strategy (July 2026) updates the privileges required to use the Test Center plugin, a test summary, a new performance tab for baseline test results, a new object selection dialog, and support for documents.

A baseline test is a saved reference snapshot of the output generated by the content objects. This includes the data returned, formatting, structural layout, and SQL. The baseline represents the expected, correct result against which future executions are compared.

The purpose for baseline tests are the following:

  • Regression Verification: Ensure that modifications to the environment do not negatively impact the accuracy or appearance of existing objects.

  • Automation: Facilitate routine, automated checking of large numbers of objects.

If you are using Strategy (July 2026) or later, you must have the server-level configuration privilege, Use Integrity Manager, to use the Test Center plugin. For more information on setting server-level privileges, see Assign Server-Level Configuration Privileges.

If you are using a version prior to Strategy (July 2026), you must have the Integrity Manager privilege to see any notes that have been added to the document.

Create a Baseline

  1. Open the Workstation page.

  2. In the Navigation pane, click Test Center. The existing tests and test results display.
  3. Click New Test in the upper right.

  4. Type a Name for the test.

  5. In the Type drop-down list, choose Baseline Test and click Next.

  6. Select the objects to create a snapshot in a desired state and click Create.

    Starting in Strategy (July 2026) or later, click Add Objects to open the object selection page or to select objects by folder, click Import Folders.

  7. Starting in Strategy (July 2026), you can enable Use Cache in Execution and Performance Test:
    • Use Cache in Execution: Uses cached results when available to reduce execution time and server load. Disable this option to force fresh execution against the Intelligence Server.
    • Performance Test: Executes the selected objects multiple times to measure performance. The number of cycles defines how many times each object runs.

  8. If any of the included objects contain prompts, you can modify the prompt settings, as well as provide any answers.

    Starting in Strategy One (April 2026), the prompt settings always prompt after object selection. If no objects include a prompt, the setting is not applied.

    Strategy (July 2026) adds support for user-defined answers.

  9. Starting in Strategy (July 2026), view a Test Summary before saving a test.

  10. After all prompt settings are established, click Save to save the baseline test.

    You can find the new test in the Test Center.

Review Baseline Test Results

  1. To see specifics, right-click a test result and select View Result.

  2. By default, you see the Overview page. The Overview page provides a high level summary of the test execution result (pass or fail) for each content object. For dashboards, each visualization displays.

  3. For objects with a Fail status, to check discrepancies and error messages, click Details.

  4. You can archive the errors. Right-click the header and select one of the following:
    • To archive errors thrown at the Objects level, select Archive
    • To archive all entries of the same error type, select Archive All with Same Error
  5. To switch to the SQL view, click SQL. This page displays query SQL for each object or visualization. Objects with execution errors display an Execution Failed icon.

  6. To switch to the Data view, click Data. This page visualizes raw dashboard result data for each object or visualization.

  7. Starting in Strategy (July 2026), for results with performance test enabled, click Performance to view the execution time.