Track Your Progress

Rasa X version 0.33.0 or higher is only compatible with Rasa Open Source 2.x. If you are on Rasa Open Source 1.x, please check the compatibility matrix for a compatible version.

Identifying successful conversations is an important step to understand what’s working and what’s not. Using this measure, you can monitor how your assistant improves as you fix bugs and make changes.

Rasa X is built to help you track your progress by tagging conversations.

Tagging Conversations via the API

For consistent progress tracking, you should find a way to automatically identify conversations that are likely to have been successful. How you do this depends on the use case of your assistant. For example, a few good indicators might be:

You can use the Rasa X API to automatically tag those conversations when those actions do or don’t occur. Here are a couple concrete examples:

Tags can be applied to conversations using a POST call to the Rasa X REST API (make sure to replace {HOST} and {conversation_id} with your own values):

curl --data '\[{"value":"review today","color":"eb4034"}\]' \
     http://{HOST}/api/conversations/{conversation_id}/data-tags

You can then focus on those specific conversations by filtering for that tag:

You can also delete a tag, removing it from all conversations, using a DELETE call to the Rasa X API.

Tagging Conversations in the UI

You can tag conversations in the Rasa X UI during the review process to identify successful conversations. Tags can also be used to identify specific problems with your assistant’s conversations, such as an intent misclassification.

In Rasa X, tags are applied by selecting a conversation in the Conversations page and using the gear icon on the right to select a tag.

You can speed up the process of manually tagging conversations as successes or failures by filtering for conversations where certain events happened. Here are some ideas: