Change the details of the test kit.

Use the test suite to evaluate and refine how your agent handles real-world response scenarios. This article explains how to modify the test suite's name and settings, manage user profiles and connections used for validation, edit or remove individual test cases, and delete the entire test suite or results. These steps help ensure that evaluations accurately reflect the user context and maintain secure access to knowledge resources and tools.

You can choose from three testing methods, also known as scoring tools, to evaluate the agent's response: Quality, similarity, and text match.

Edit the details of the test toolkit.

You can change the details of the test suite, such as the account used for authentication and the test methods used.

1. Access the agent's Evaluation page .

2. Choose a test suite.

3. In the testing toolset, select the test case you want to modify.

4. (Optional) Change the name of the test suite.

5. Add or modify test methods. Each test method measures different values ​​and requires different configurations.

6. Select Manage profile to add an account, or select the current profile to manage connections, or select a different profile. Automated testing uses the authentication of the selected test account. Multiprofile evaluation is only supported for connector-independent agents. If your agent has knowledge sources or tools that require specific authentication, you can select the appropriate account for your testing process.

Note : When Copilot Studio creates test cases or runs assessments, it uses the credentials of the connected account to access the agent's knowledge resources and tools. The created test cases may include sensitive data that the connected account can access. Any producer with access to the agent can also view the test suites associated with that agent.

Manage user profiles and connections.

You can run test suites using user account authentication. This authentication method allows your agent to access the knowledge resources and tools necessary to accomplish its goals.

You can use profiles to model specific user experiences. For example, a manager's user profile might access different knowledge resources than an intern's user profile, and the agent would return different results. Multiprofile evaluation is only supported for connector-independent agents.

Important Note : User profiles in the test toolkit cannot provide authentication for the tools. When you run the assessment, the agent must use your logged-in account to authenticate the tool connection. If you select a different user profile or the agent's tool connection does not use your account for authentication, the assessment will fail with the message "This account cannot connect to the tools". To resolve this, log in with the account configured with the tool connector and then run the assessment.

The test results show which user profile was used.

Note :

When Copilot Studio creates test cases or runs assessments, it uses the credentials of the connected account to access the agent's knowledge resources and tools. The created test cases may include sensitive data that the connected account can access. Any creator with access to the agent can also view the test toolkits associated with that agent.

The evaluation agent uses user authentication and requires access through the Microsoft Copilot Studio connector. If the administrator disables this connection, you cannot run tests using the evaluation tool.

To add or change user profiles in the test suite:

1. Open the test toolkit, then select Manage profile .

2. Select the User drop-down menu , then:

1. Choose the user account you want to use, or
2. Select Add an account , then log in to your account.

3. For connections with warnings, select them. Change the existing connection to an active one, select Reconnect to try re-establishing the existing connection, or select Create new connection to try a new connection.

4. For new connections, enter the required connection details, then select Connect .

5. When all connections are working, select Save .

Delete the test kit or test results.

You can delete test cases or test suites that you no longer need.

1. Access the agent's Evaluation page .

2. In the Test sets section , you can delete a test suite by performing one of the following two steps:

1. Select the three dots (…) on the test toolkit tab, then select Delete .
2. Select the test toolkit to open it, then select the three dots (.) in the Configure test set pane , and then select Delete .

3. In the Recent results section , you can delete a test result by performing one of the following two steps:

1. Hover your mouse over the test result you want to delete, select the three dots (.), and then select Delete test .
2. Select the test result to open, then select the three dots (.) in the Evaluation summary pane , and then select Delete .

You've just finished reading the article "Change the details of the test kit." edited by the TipsMake team. You can save change-the-details-of-the-test-kit.pdf to your computer here to read later or print it out. We hope this article has provided you with many useful tech tips and tricks. You can search for similar articles on tips and guides. Thank you for reading and for following us regularly.