How to use HiTZ/BERnaT-base with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="HiTZ/BERnaT-base")
# Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("HiTZ/BERnaT-base") model = AutoModelForMaskedLM.from_pretrained("HiTZ/BERnaT-base")
merge.txt is used with RobertaTokenizer but not XLMRobertaTokenizer
merge.txt
RobertaTokenizer
XLMRobertaTokenizer
· Sign up or log in to comment
