To execute a test set, you must choose the appropriate bot to run the test against the test set. You can choose a bot from your AWS account from the drop down menu under Test Set. This operation will test your selected bot against your validated test data to report performance metrics against the baseline data from the test set.
To execute a test in the Test Workbench
-
In the test set record page, choose Execute Test.
-
Select the test set you want to use in the test.
-
Select the name of the bot to use in the test from the Bot drop down menu.
-
Choose a bot alias, if applicable, from the Bot alias drop down menu.
-
From the Languages selection, choose a version of English.
-
Select Text or Audio for the Modality type.
-
Choose your Amazon S3 location. (audio only)
-
Select your Endpoint selection for your bot. (streaming only)
-
Select the Validate coverage button to confirm your test in ready to run. If there are any errors present in the validation step, review the previous parameters and make corrections.
-
Select Execute to run the test.
-
A message confirms that the test is successfully executed.
