👋 Introducing the Rasa Playground

Integrate Cohere with Rasa Pro

post by UniQuest on Apr 3, 2024

config.yml file is as follows:

recipe: default.v1
language: en
pipeline:

- name: “LLMCommandGenerator”
  llm:
    type: “cohere”
    model: “command”
    temperature: 0.7
    embeddings:
      type: “cohere”
      model: “embed-english-v2.0”

policies:

- name: FlowPolicy
  assistant_id: 20240402-153011-kind-salmon

Error encountered while accessing rasa shell:

Your input → hi

2024-04-03 12:47:40 ERROR rasa.utils.log_utils - [error ] llm_command_generator.llm.error error=AttributeError(“module ‘cohere’ has no attribute ‘error’”) Sorry, I am having trouble with that. Please try again in a few minutes.

post by Balowen on Apr 3, 2024

Hi @UniQuest,

Which version of rasa and cohere are you using? Please make sure that you have set COHERE_API_KEY environment variable as described here: LLM Providers.

post by UniQuest on Apr 3, 2024

Hey @Balowen,

I am using Command R model which provides free trial key so that I could check the functioning before purchasing. I have even set the COHERE_API_KEY . The error says AttributeError(“module ‘cohere’ has no attribute ‘error’”.

post by Balowen on Apr 4, 2024

We got to the root of the problem. Langchain is using the following import in cohere.py which is failing as the code was moved: cohere.error.CohereError (should be cohere.CohereError ).

So that is failing. We recently switched to the async execution of our llm calls. In the sync version that particular code was not called and did not caused any errors.

It looks like the issue is still present in the latest version of langchain ( link). We can open an issue on langchain side to fix this, but I’m afraid we cannot use cohere as of now with Rasa Pro 3.8.0.

A possible workaround for now is using rasa pro 3.7.9 and downgrading cohere to an older version:

pip install cohere==4.57

We will update our documentation and I will let you know if/when it is fixed. Thanks for trying out Rasa Pro!

post by UniQuest on Apr 5, 2024

Okay!! Will check on that. Thank you!!

post by RakshitAralimatti on May 14, 2024

Hi@Balowen Is the above issue fixed I am facing the same error using rasa pro 3.8.5