daslab-testing/Llama-3.1-8B-Instruct-mxfp-w4-a4-MicroQAT-hadamard-transform
5B
•
Updated
•
14
FP-Quant-dev
Experimental versions of FP-Quant models
-
-
daslab-testing/Llama-3.1-8B-Instruct-nvfp-w4-a4-MicroQAT-hadamard-transform
5B • Updated • 1 -
daslab-testing/Llama-3.2-3B-Instruct-nvfp-w4-a4-MicroQAT-hadamard-transform
2B • Updated • 1 -
daslab-testing/Llama-3.2-3B-Instruct-mxfp-w4-a4-MicroQAT-hadamard-transform
2B • Updated • 3 -
daslab-testing/Llama-3.1-8B-Instruct-mxfp-w4-a4-GPTQ-hadamard-transform-gs128
5B • Updated -
daslab-testing/Llama-3.1-8B-Instruct-nvfp-w4-a4-GPTQ-hadamard-transform-gs128
5B • Updated -
daslab-testing/Llama-3.2-3B-Instruct-FPQuant-GPTQ-NVFP4-hadamard-gs128
2B • Updated -
daslab-testing/Llama-3.2-3B-Instruct-FPQuant-GPTQ-MXFP4-hadamard-gs128
2B • Updated • 1 -
daslab-testing/Llama-3.1-8B-Instruct-nvfp-w4-a4-RTN-hadamard-transform-gs128
5B • Updated -
daslab-testing/Llama-3.1-8B-Instruct-mxfp-w4-a4-RTN-hadamard-transform-gs128
5B • Updated -
daslab-testing/Llama-3.2-3B-Instruct-FPQuant-RTN-MXFP4-hadamard-gs128
2B • Updated -
daslab-testing/Llama-3.2-3B-Instruct-FPQuant-RTN-NVFP4-hadamard-gs128
2B • Updated -
daslab-testing/Qwen3-8B-FPQuant-RTN-NVFP4-hadamard-gs128
5B • Updated -
daslab-testing/Qwen3-8B-FPQuant-RTN-MXFP4-hadamard-gs128
5B • Updated • 1 -
daslab-testing/Qwen3-14B-FPQuant-GPTQ-MXFP4-hadamard-gs128
9B • Updated • 3 -
daslab-testing/Qwen3-14B-FPQuant-GPTQ-NVFP4-hadamard-gs128
9B • Updated • 2 -
daslab-testing/Qwen3-14B-FPQuant-RTN-MXFP4-hadamard-gs128
9B • Updated -
daslab-testing/Qwen3-14B-FPQuant-RTN-NVFP4-hadamard-gs128
9B • Updated • 1 -
daslab-testing/Qwen3-32B-FPQuant-GPTQ-NVFP4-hadamard-gs128
19B • Updated • 2 -
daslab-testing/Qwen3-32B-FPQuant-GPTQ-MXFP4-hadamard-gs128
18B • Updated -
daslab-testing/Qwen3-32B-FPQuant-RTN-NVFP4-hadamard-gs128
19B • Updated -
daslab-testing/Qwen3-32B-FPQuant-RTN-MXFP4-hadamard-gs128
18B • Updated -
daslab-testing/Llama-3.2-1B-Instruct-FPQuant-GPTQ-NVFP4-hadamard-gs128
0.8B • Updated • 2 -
daslab-testing/Llama-3.2-1B-Instruct-FPQuant-RTN-NVFP4-hadamard-gs128
0.8B • Updated • 1 -
daslab-testing/Llama-3.2-1B-Instruct-FPQuant-RTN-MXFP4-hadamard-gs128
0.8B • Updated • 1 -
daslab-testing/Llama-3.2-1B-Instruct-FPQuant-GPTQ-MXFP4-hadamard-gs128
0.8B • Updated • 2 -
daslab-testing/Qwen3-8B-FPQuant-GPTQ-MXFP4-hadamard-gs128
5B • Updated • 3 -
daslab-testing/Qwen3-8B-FPQuant-GPTQ-NVFP4-hadamard-gs128
5B • Updated • 1