Firworks's picture

Firworks

Firworks

·

firworksyt

AI & ML interests

Local Inference, Fine Tunes, & NVFP4 Quantization

Recent Activity

liked a model about 23 hours ago

MiniMaxAI/MiniMax-M2.1

new activity 1 day ago

cerebras/Qwen3-Coder-REAP-25B-A3B:NVFP4?

updated a model 1 day ago

Firworks/Qwen3-Coder-REAP-25B-A3B-nvfp4

View all activity

Organizations

None yet

New activity in cerebras/Qwen3-Coder-REAP-25B-A3B 1 day ago

NVFP4?

#9 opened 1 day ago by

New activity in Firworks/NVIDIA-Nemotron-3-Nano-30B-A3B-nvfp4 6 days ago

"NotImplementedError: is_act_and_mul=False" Error

#1 opened 10 days ago by

New activity in Firworks/Ministral-3-14B-Instruct-2512-nvfp4 7 days ago

Issues while running the model within vLLMs nightly docker build as given in the readme

#1 opened 7 days ago by

New activity in zai-org/GLM-4.6V-Flash 10 days ago

vLLM error

#8 opened 18 days ago by

New activity in Firworks/Cydonia-24B-v4.3-nvfp4 10 days ago

Need more info about your quant

#1 opened 10 days ago by

New activity in google/gemma-3-270m-it 12 days ago

Delete config.json

#14 opened 12 days ago by

Delete model.safetensors

#13 opened 12 days ago by

New activity in Firworks/INTELLECT-3-nvfp4 13 days ago

does not appear to have a file named configuration_glm4_moe.py

#7 opened 15 days ago by

New activity in cerebras/MiniMax-M2-REAP-139B-A10B 13 days ago

NVFP4 version

#2 opened 14 days ago by

New activity in Firworks/KAT-Dev-72B-Exp-nvfp4 14 days ago

What tok/sec do you get on a PRO 6000 Blackwell?

#3 opened 15 days ago by

New activity in Firworks/Devstral-Small-2-24B-Instruct-2512-nvfp4 16 days ago

What problem are you having? I might be able to help.

#2 opened 16 days ago by

New activity in ddh0/Cassiopeia-70B 16 days ago

This Model Rules

#2 opened 16 days ago by

New activity in Firworks/Devstral-Small-2-24B-Instruct-2512-nvfp4 16 days ago

That's so cool!

#1 opened 16 days ago by

New activity in Firworks/Ministral-3-14B-Reasoning-2512-nvfp4 18 days ago

Hi, could you try quantizing Devstral-2-123B-Instruct-2512?

#1 opened 18 days ago by

New activity in Firworks/GLM-4.5-Air-REAP-82B-A12B-nvfp4 18 days ago

“I am unable to start this model using vllm serve on the RTX 5090.”

#1 opened 24 days ago by

New activity in Firworks/Hermes-4.3-36B-nvfp4 19 days ago

Nice!

#1 opened 21 days ago by

New activity in Firworks/KAT-Dev-72B-Exp-nvfp4 23 days ago

How did you quantize it?

#1 opened 23 days ago by

New activity in Firworks/INTELLECT-3-nvfp4 23 days ago

Request quantization model

#6 opened 25 days ago by

New activity in Firworks/MiroThinker-v1.0-30B-nvfp4 24 days ago

Request quantization of VLM

#2 opened about 1 month ago by

New activity in Firworks/INTELLECT-3-nvfp4 25 days ago

cost estimates?

#5 opened 25 days ago by