Spaces:

AtAndDev
/

Marco-o1-Q4

Runtime error

nikravan commited on Nov 22, 2024

Commit

62ebda0

verified ·

1 Parent(s): aa3fb34

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -111,7 +111,7 @@ quantization_config = BitsAndBytesConfig(
     load_in_4bit=True,
     bnb_4bit_compute_dtype=torch.bfloat16
 )
-tokenizer = AutoTokenizer.from_pretrained(MODEL_ID)
 model = AutoModelForCausalLM.from_pretrained(
     MODEL_ID,
     device_map="auto",

     load_in_4bit=True,
     bnb_4bit_compute_dtype=torch.bfloat16
 )
+tokenizer = AutoTokenizer.from_pretrained('AIDC-AI/Marco-o1')
 model = AutoModelForCausalLM.from_pretrained(
     MODEL_ID,
     device_map="auto",