File size: 596 Bytes
fd18d25 2e64329 fd18d25 5c79f7b fd18d25 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 |
---
license: mit
license_link: https://huggingface.co/rednote-hilab/dots.llm1.inst/blob/main/LICENSE
base_model: rednote-hilab/dots.llm1.inst
base_model_relation: quantized
quantized_by: turboderp
tags:
- exl3
---
EXL3 quants of [dots.llms1.inst](https://huggingface.co/rednote-hilab/dots.llm1.inst)
[2.00 bits per weight](https://huggingface.co/turboderp/dots.llm1.inst-exl3/tree/2.0bpw)
[2.50 bits per weight](https://huggingface.co/turboderp/dots.llm1.inst-exl3/tree/2.5bpw)
[4.00 bits per weight](https://huggingface.co/turboderp/dots.llm1.inst-exl3/tree/4.0bpw)
(more to come) |