Cannot change from openai to huggingface_hub - Rasa CALM - Rasa Community Forum
post by marcin.brzezanski on Jul 29, 2024
I have followed other LLM\Embedding tutorial and changed my config to this:
recipe: default.v1
language: en
pipeline:
- name: SingleStepLLMCommandGenerator
llm:
type: "huggingface_hub"
repo_id: "HuggingFaceH4/zephyr-7b-beta"
task: "text-generation"
embeddings:
type: "huggingface_hub"
repo_id: "sentence-transformers/all-mpnet-base-v2"
task: "feature-extraction"
policies:
- name: FlowPolicy
assistant_id: 20240729-132344-grouchy-boulevard
I also set enviormental variable HUGGINGFACEHUB_API_TOKEN, yet when I try to train rasa i get OPEN AI API errors.
post by Balowen on Jul 30, 2024
Hi Marcin,
This is most likely coming from the flow_retrieval feature that uses openai by default for the embeddings. You need to configure it to use other embeddings or turn that feature off: flow-retrieval