Powered by llm-compressor, it enables inference on vllm.
- Downloads last month
- 34
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
馃檵
Ask for provider support
Powered by llm-compressor, it enables inference on vllm.