Testing the Chatbot Training Data to Improve Predictability - Documentation for Bmc Helix Virtual Agent 21.3

Testing the Chatbot Training Data to Improve Predictability - Documentation for Bmc Helix Virtual Agent 21.3

As an administrator, you can test whether the chatbot application is able to understand the conversation context and provides appropriate responses when interacting with users in natural language, and perform tasks on behalf of end users. You must create a CSV data set to test the chatbot application. The test results provide the exact problem area when the chatbot does not respond appropriately so that administrators can rectify the chatbot intents, entities, and dialogs (that serve as training data). The tests are particularly important when you are implementing a new data set, localized data set, or if you have made major changes to the data set.

For more information, see Leveraging machine learning metrics to improve chatbot predictability.

CSV data set structure for a chatbot application

You must create a CSV file to test a chatbot application. The CSV file should have the following structure:  

  • Each row contains a natural language text and the intent that applies to the text.

Example of a test CSV file

The following image is an example of a CSV test data file for chatbot:

Before you begin

  • Ensure that you have created intents, entities, and dialogs. 
  • Ensure that you have created the CSV test data file. 
  • If you are using localized Chatbot Skill, ensure that your test data locale matches with the workspace locale.
Elena Rostova
Author

Elena Rostova

Elena Rostova holds a Master's degree in Public Health Journalism. She covers groundbreaking medical research, holistic wellness trends, mental health awareness, and nutritional science.