Production Checklist

Rasa X version 0.33.0 or higher is only compatible with Rasa Open Source 2.x. If you are on Rasa Open Source 1.x, please check the compatibility matrix for a compatible version.

User feedback should continue to drive your development when your assistant is in production. Below you will find a list of tasks you should going into production.

Share

• Try sharing your assistant with at least 50 test users
• Connect and test your production channel with users

Review

• Decide how frequently you will read through new conversations (e.g. daily)

Annotate

• Collect 75 NLU training examples per intent per intent at a minimum
• Ensure over 90% of these examples are from real conversations with users

Test

• Ensure each intent, entity, action, etc. is in your test stories 5+ times
• Set up continuous integration and deployment to ship updates reliably

Track

• Come up with a way to identify successful or unsuccessful conversations
• Use the Rasa X API to automatically tag those conversations, if possible

Fix

• Determine how you will track issues (e.g. Trello) that need to be fixed