Dataset approach to GPTQ quantization
#1
by
KrisPi
- opened
Hi,
Would you be so kind as to share the approach to such lossless quantization? Have you used the same high-quality instructions that were used in fine-tuning?
Best regards!
Hi,
Yes, we used a small subset of samples sampled from the fine-tuning dataset for quantization.
codefuse-admin
changed discussion status to
closed