加载数据处理器报错

[lokking]

from transformers import LayoutXLMTokenizer, LayoutLMv3ImageProcessor, LayoutLMv3Processor

加载 Tokenizer 和 ImageProcessor

tokenizer = LayoutXLMTokenizer.from_pretrained(model_name_path)
image_processor = LayoutLMv3ImageProcessor.from_pretrained(model_name_path, apply_ocr=False)

创建 Processor

processor = LayoutLMv3Processor(tokenizer=tokenizer, image_processor=image_processor, apply_ocr=False)
The tokenizer class you load from this checkpoint is not the same type as the class this function is called from. It may result in unexpected tokenization.
The tokenizer class you load from this checkpoint is 'XLMRobertaTokenizer'.
The class this function is called from is 'LayoutXLMTokenizer'.

[ckert-W]

from transformers import LayoutXLMTokenizer, LayoutLMv3ImageProcessor, LayoutLMv3Processor

加载 Tokenizer 和 ImageProcessor

tokenizer = LayoutXLMTokenizer.from_pretrained(model_name_path) image_processor = LayoutLMv3ImageProcessor.from_pretrained(model_name_path, apply_ocr=False)

创建 Processor

processor = LayoutLMv3Processor(tokenizer=tokenizer, image_processor=image_processor, apply_ocr=False) The tokenizer class you load from this checkpoint is not the same type as the class this function is called from. It may result in unexpected tokenization. The tokenizer class you load from this checkpoint is 'XLMRobertaTokenizer'. The class this function is called from is 'LayoutXLMTokenizer'.

我是将 transformers/models/layoutlmv3/processing_layoutlmv3 中的第49行改为： "tokenizer_class = ("LayoutLMv3Tokenizer", "LayoutLMv3TokenizerFast",'XLMRobertaTokenizer','XLMRobertaTokenizerFast','LayoutXLMTokenizer')" ，就可以正常运行了