Likes - Activity - DivyashaAgrawal - Rasa Community Forum

Feedback on ConveRT Model + Rasa NLU

Hi @dakshvar22,
of course you are welcome at any time. A simple supervised embedding config resulted in:

dataset:
rasa.nlu.test - test Accuracy: 0.927 (0.028)
rasa.nlu.test - test F1-score: 0.908 (0.038)
rasa.nlu.test - test Precision: 0.893 (0.047)

dataset:
test Accuracy: 0.923 (0.004)
te…

@JulianGerhard Thanks for sharing the numbers. Very interesting that simple supervised embedding config is on par or even a bit better in some cases.

Hey,
Recently the folks at PolyAI have open-sourced a new sentence encoding model called ConveRT which is pretrained on a large conversational dataset and hence claims better conversational representations over traditional large language models like BERT, etc.
The idea resonates very well with what …