Vllm support ?
#1
by
justinliu12138
- opened
How to use it through vllm serve……
We are currently working hard on this and expect to add vLLM support in the next 1-2 weeks.
sudongpo
changed discussion status to
closed