Use the chat testing environment to provide feedback that improves the bot's responses
Taylor Jennings
The chat testing feature allows admins to test bot responses but that feedback doesn't influence how the bot performs in production. Testing and training are completely disconnected.
Feedback provided during chat testing, such as marking a response as incorrect or suggesting a better answer, should feed back into the bot's training to improve future responses.
A testing environment that doesn't inform training is only half useful. Closing the loop between testing feedback and model improvement makes the training process more efficient and data-driven.
Taylor Jennings
Merged in a post:
Use the results of the Testing tab to train Chat AI
M
Mary McMillan
Currently the Testing tab in Chat AI is only for verifying if the strategies and guidances are working as expected. It would be very useful if those tests could be used to train the AI and let it know when it has a good vs. bad response.