How to solve `AttributeError: Qwen2TokenizerFast has no attribute start_image_token`
Traceback (most recent call last):
File "/home/Guanjq/Work/MTXray/test_script/lab4_eval_mtxray_version_1_6_compare.py", line 312, in
generator = InternVL3_5_8B()
File "/home/Guanjq/Work/MTXray/test_script/../projs/QWenVL/generation.py", line 235, in init
self.processor = AutoProcessor.from_pretrained(
File "/mnt/Guanjq/miniconda3/envs/qwen/lib/python3.10/site-packages/transformers/models/auto/processing_auto.py", line 376, in from_pretrained
return processor_class.from_pretrained(
File "/mnt/Guanjq/miniconda3/envs/qwen/lib/python3.10/site-packages/transformers/processing_utils.py", line 1187, in from_pretrained
return cls.from_args_and_dict(args, processor_dict, **kwargs)
File "/mnt/Guanjq/miniconda3/envs/qwen/lib/python3.10/site-packages/transformers/processing_utils.py", line 982, in from_args_and_dict
processor = cls(*args, **processor_dict)
File "/mnt/Guanjq/miniconda3/envs/qwen/lib/python3.10/site-packages/transformers/models/internvl/processing_internvl.py", line 95, in init
self.start_image_token = tokenizer.start_image_token
File "/mnt/Guanjq/miniconda3/envs/qwen/lib/python3.10/site-packages/transformers/tokenization_utils_base.py", line 1111, in getattr
raise AttributeError(f"{self.class.name} has no attribute {key}")
AttributeError: Qwen2TokenizerFast has no attribute start_image_token
same
