模型在复杂工具调用出现输出乱码的

#47

by lichenxi2222 - opened Sep 22

Sep 22

通过vllm启动部署后，会出现下述乱码输出的问题。
部分启动参数如下
--enable-auto-tool-choice
--tool-call-parser deepseek_v31
--chat-template examples/tool_chat_template_deepseekv31.jinja

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment