Nemotron models that have been converted and/or quantized to work well in vLLM
Michael Goin
mgoin
AI & ML interests
LLM inference optimization, compression, quantization, pruning, distillation
Recent Activity
updated
a model
15 days ago
RedHatAI/Llama-3.2-1B-FP8
new activity
28 days ago
kernels-community/vllm-flash-attn3:Support for B200s?
liked
a model
about 1 month ago
moondream/moondream3-preview
Organizations
models
100
mgoin/Qwen3-0.6B-NVFP4
0.6B
•
Updated
mgoin/mlperf-inference-llama3.1-8b-data
Updated
mgoin/Llama-3.1-8B-Instruct-FP8-BLOCK
8B
•
Updated
•
3
mgoin/SEMIKONG-70B-W4A16-G128
11B
•
Updated
mgoin/llama-4-tiny-random
Text Generation
•
6.69M
•
Updated
mgoin/Qwen1.5-14B-Chat-GPTQ
Text Generation
•
Updated
mgoin/pixtral-12b
Image-Text-to-Text
•
13B
•
Updated
•
82
•
1
mgoin/Llama-3.2-1B-Instruct-FP8-ATTN
1B
•
Updated
mgoin/Llama-3.2-1B-Instruct-FP8-dynamic-ATTN
1B
•
Updated
mgoin/Pixtral-Large-Instruct-2411
Updated
•
1