amd/Mixtral-8x7B-Instruct-v0.1-WMXFP4FP8-AMXFP4FP8-AMP-KVFP8 at refs/pr/3

Mixtral-8x7B-Instruct-v0.1-WMXFP4FP8-AMXFP4FP8-AMP-KVFP8

72.2 GB

2 contributors

History: 4 commits

XuebinWang

update Quark quantized Auto Mixed Precision (AMP) Mixtral-8x7B-Instruct-v0.1 model with better accuracies

d992ee4 verified about 1 month ago

.gitattributes

1.52 kB

initial commit 2 months ago
chat_template.jinja

1.06 kB

upload model (#1) 2 months ago
config.json

1.13 MB

update Quark quantized Auto Mixed Precision (AMP) Mixtral-8x7B-Instruct-v0.1 model with better accuracies about 1 month ago
generation_config.json

111 Bytes

update Quark quantized Auto Mixed Precision (AMP) Mixtral-8x7B-Instruct-v0.1 model with better accuracies about 1 month ago
model-00001-of-00007.safetensors

4.96 GB
xet

upload model (#1) 2 months ago
model-00001-of-00008.safetensors

4.98 GB
xet

update Quark quantized Auto Mixed Precision (AMP) Mixtral-8x7B-Instruct-v0.1 model with better accuracies about 1 month ago
model-00002-of-00007.safetensors

4.99 GB
xet

upload model (#1) 2 months ago
model-00002-of-00008.safetensors

4.98 GB
xet

update Quark quantized Auto Mixed Precision (AMP) Mixtral-8x7B-Instruct-v0.1 model with better accuracies about 1 month ago
model-00003-of-00007.safetensors

4.94 GB
xet

upload model (#1) 2 months ago
model-00003-of-00008.safetensors

4.99 GB
xet

update Quark quantized Auto Mixed Precision (AMP) Mixtral-8x7B-Instruct-v0.1 model with better accuracies about 1 month ago
model-00004-of-00007.safetensors

4.99 GB
xet

upload model (#1) 2 months ago
model-00004-of-00008.safetensors

4.97 GB
xet

update Quark quantized Auto Mixed Precision (AMP) Mixtral-8x7B-Instruct-v0.1 model with better accuracies about 1 month ago
model-00005-of-00007.safetensors

4.98 GB
xet

upload model (#1) 2 months ago
model-00005-of-00008.safetensors

5 GB
xet

update Quark quantized Auto Mixed Precision (AMP) Mixtral-8x7B-Instruct-v0.1 model with better accuracies about 1 month ago
model-00006-of-00007.safetensors

4.94 GB
xet

upload model (#1) 2 months ago
model-00006-of-00008.safetensors

4.95 GB
xet

update Quark quantized Auto Mixed Precision (AMP) Mixtral-8x7B-Instruct-v0.1 model with better accuracies about 1 month ago
model-00007-of-00007.safetensors

4.14 GB
xet

upload model (#1) 2 months ago
model-00007-of-00008.safetensors

4.94 GB
xet

update Quark quantized Auto Mixed Precision (AMP) Mixtral-8x7B-Instruct-v0.1 model with better accuracies about 1 month ago
model-00008-of-00008.safetensors

3.44 GB
xet

update Quark quantized Auto Mixed Precision (AMP) Mixtral-8x7B-Instruct-v0.1 model with better accuracies about 1 month ago
model.safetensors.index.json

243 kB

update Quark quantized Auto Mixed Precision (AMP) Mixtral-8x7B-Instruct-v0.1 model with better accuracies about 1 month ago
special_tokens_map.json

437 Bytes

upload model (#1) 2 months ago
tokenizer.json

3.51 MB

update the AMP model with better accuracy numbers and lower effective bitwidth (5.6) (#2) about 1 month ago
tokenizer.model

493 kB
xet

upload model (#1) 2 months ago
tokenizer_config.json

1.05 kB

update the AMP model with better accuracy numbers and lower effective bitwidth (5.6) (#2) about 1 month ago