### Feedback on ConveRT Model + Rasa NLU

Hi [@dakshvar22](https://forum.rasa.com/u/dakshvar22),  
of course you are welcome at any time. A simple supervised embedding config resulted in:

**dataset:**  
rasa.nlu.test - test Accuracy: 0.927 (0.028)  
rasa.nlu.test - test F1-score: 0.908 (0.038)  
rasa.nlu.test - test Precision: 0.893 (0.047)

**dataset:**  
test Accuracy: 0.923 (0.004)  
te…

[@JulianGerhard](https://forum.rasa.com/u/juliangerhard) Thanks for sharing the numbers. Very interesting that simple supervised embedding config is on par or even a bit better in some cases.

Hey,  
Recently the folks at PolyAI have open-sourced a new sentence encoding model called [ConveRT](https://arxiv.org/abs/1911.03688) which is pretrained on a large conversational dataset and hence claims better conversational representations over traditional large language models like BERT, etc.  
The idea resonates very well with what …