Baseline Tests

Strategy (August 2026) adds support for search objects and updates the New Test clickpath.

Strategy (July 2026) updates the privileges required to use the Test Center plugin, a test summary, a new performance tab for baseline test results, a new object selection dialog, and support for documents.

Starting in Strategy One (April 2026), you can archive errors generated by the baseline test.

A baseline test is a saved reference snapshot of the output generated by the content objects. This includes the data returned, formatting, structural layout, and SQL. The baseline represents the expected, correct result against which future executions are compared.

The purpose for baseline tests are the following:

  • Regression Verification: Ensure that modifications to the environment do not negatively impact the accuracy or appearance of existing objects.

  • Automation: Facilitate routine, automated checking of large numbers of objects.

If you are using Strategy (July 2026) or later, you must have the server-level configuration privilege, Use Integrity Manager, to use the Test Center plugin. For more information on setting server-level privileges, see Assign Server-Level Configuration Privileges.

If you are using a version prior to Strategy (July 2026), you must have the Integrity Manager privilege to see any notes that have been added to the document.

Create a Baseline

  1. Open the Workstation window.

  2. In the Navigation pane, click next to Test Center.

  3. If you are using Strategy (August 2026) or later, choose Comparison Test and type a Name for the test.

  4. If you are using a version prior to Strategy (August 2026), type a Name for the test and in the Type drop-down list, choose Comparison Test, then click Next.

  5. Select the objects to create a snapshot in a desired state and click Create.

    Starting in Strategy (July 2026) or later, click Add Objects to open the object selection page or to select objects by folder, click Import Folders.

    Starting in Strategy One (October 2025), you can choose cubes and Mosaic models. Starting in Strategy One (January 2026), you can choose cards and reports. Starting in Strategy (July 2026), you can choose documents. Starting in Strategy (August 2026), you can choose search objects.

  6. Optionally select the check box next to the following settings:
    • Use Cache in Execution: Starting in Strategy One (July 2026), use cached results when available to reduce execution time and server load. Disable this option to force fresh execution against the Intelligence Server.
    • Performance Test: Starting in Strategy One (July 2026), execute the selected objects multiple times to measure performance. The number of cycles defines how many times each object runs.

    • Include Hidden Objects in Search Objects: Starting in Strategy (August 2026), display objects that have been set to be hidden in your search objects.

      This option only displays if you add a search object to your test.

  7. If any of the included objects contain prompts, you can modify the prompt settings, as well as provide any answers.

    Starting in Strategy One (April 2026), the prompt settings always prompt after object selection. If no objects include a prompt, the setting is not applied.

    Strategy (July 2026) adds support for user-defined answers.

  8. Starting in Strategy (July 2026), view a Test Summary before saving a test.

  9. After all prompt settings are established, click Save to save the baseline test.

    You can find the new test in the Test Center.

Review Baseline Test Results

  1. To see specifics, right-click a test result and select View Result.

  2. By default, you see the Overview page. The Overview page provides a high level summary of the test execution result (pass or fail) for each content object. For dashboards, each visualization displays.

  3. For objects with a Fail status, to check discrepancies and error messages, click Details.

  4. Starting in Strategy One (April 2026), you can archive the errors. Right-click the header and select one of the following:
    • To archive errors thrown at the Objects level, select Archive
    • To archive all entries of the same error type, select Archive All with Same Error
  5. To switch to the SQL view, click SQL. This page displays query SQL for each object or visualization. Objects with execution errors display an Execution Failed icon.

  6. To switch to the Data view, click Data. This page visualizes raw dashboard result data for each object or visualization.

  7. Starting in Strategy (July 2026), for results with performance test enabled, click Performance to view the execution time.