---
license: apache-2.0
---
Powered by llm-compressor, it enables inference on vllm.