Loading Bert language weights offline - Getting Started with Rasa / Tutorials, Resources & Videos - Rasa Community Forum

Loading Bert language weights offline

post by SKP on Aug 14, 2020

HI

When we run “rasa train” in our server, we find the below error.

“OSError: Model name ‘bert-base-uncased’ was not found in tokenizers model name list (bert-base-uncased, bert-large-uncased, bert-base-cased, bert-large-cased, bert-base-multilingual-uncased, bert-base-multilingual-cased, bert-base-chinese, bert-base-german-cased, bert-large-uncased-whole-word-masking, bert-large-cased-whole-word-masking, bert-large-uncased-whole-word-masking-finetuned-squad, bert-large-cased-whole-word-masking-finetuned-squad, bert-base-cased-finetuned-mrpc, bert-base-german-dbmdz-cased, bert-base-german-dbmdz-uncased, bert-base-finnish-cased-v1, bert-base-finnish-uncased-v1, bert-base-dutch-cased). We assumed ‘bert-base-uncased’ was a path, a model identifier, or url to a directory containing vocabulary files named [‘vocab.txt’] but couldn’t find such vocabulary files at this path or url.”

Previously we got “https://s3.amazonaws.com/models.huggingface.co/bert/bert-base-uncased-tf_model.h5 from cache during training.” error and we downloaded the weight files in our server. We then tried running this offline and also tried to modify the location path in the “class PreTrainedTokenizer(object)” of “tokenization_utils.py” file. I have following questions. can some one help, pl?

  1. what to do (step wise) to run the “bert-base-uncased” offline in our server

  2. Is it a good practice?

Thanks

post by 1412392 on Nov 17, 2020

any news on it?

Related topics

Topic Replies Views Activity
Using BERT with RASA 10 7.2k Sep 2020
Can’t load bert German model from huggingface 2 2.5k Jun 2022
Pre-trained BERT embeddings weight shape inconsistency 4 908 Jul 2021
Rasa BERT, load weights from cache 7 3.5k May 2021
I needed to use RASA3 to train Chinese, but my configuration pipeline could not get bert-base-chinese, which led to my training error 0 546 Sep 2023