pytorch
/

Phi-4-mini-instruct-AWQ-INT4

Text Generation

text-generation-inference

Model card Files Files and versions

jerryzh168 commited on Sep 23

Commit

07d8a8a

·

verified ·

1 Parent(s): d0fdb5a

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -159,6 +159,7 @@ quantize_(
     quant_config,
 )
 tasks = ["mmlu_pro"]
 TransformerEvalWrapper(
     model=model,
     tokenizer=tokenizer,

     quant_config,
 )
 tasks = ["mmlu_pro"]
+calibration_limit = 2
 TransformerEvalWrapper(
     model=model,
     tokenizer=tokenizer,