Differences between the two heretic versions of Cydonia 24b v4.3
Hi @coder3101
What are the differences between the two heretic versions you made of Cydonia 24b v4.3 ?
Thank You
v1 is has almost zero refusal but at the cost of some divergence to original model.
v2 has slightly higher (still better than original) refusal but almost no divergence from original model.
If you feel, model quality is off the original model, use v2. If you need absolute best refusal, always use v1.
In model card you will find both refusal and KL divergence.
Where gguf? :)
Besides modelcard, under fine tune section:
https://huggingface.co/models?other=base_model:quantized:coder3101/Cydonia-24B-v4.3-heretic-v2
These are both really good, but I think v1 is better.
Would you have the time to make a v3 that is like v1, but diverges even more from the original model in the direction it's already diverging ?
At that point you could probably even give it a different name, because it won't really be a Cydonia anymore.
I will try that with a new heretic version!