是否支持FP8呢，如何转换为FP8

by houxiaowei - opened about 1 month ago

about 1 month ago

是否支持FP8呢，如何转换为FP8

OpenGVLab org 26 days ago

您好，支持的，转换方法可参考这个PR里的内容 https://github.com/InternLM/lmdeploy/pull/4018

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment