Consolidated safetensors
#60
by
Aktsvigun
- opened
Hi
@patrickvonplaten
, could you please tell me how you saved the model into consolidated.safetensors? My vllm==0.8.3 can only load the model if saved to consolidated.safetensors - it cannot load this model from shared checkpoints.