DeepSeek-OCR-DEMO

Running on Zero

axiilay commited on Oct 20

Commit

d8b2be7

1 Parent(s): 3da4f0d

Correctly move the model to the GPU AND change its data type

Files changed (1) hide show

app.py CHANGED Viewed

@@ -14,7 +14,7 @@ model = AutoModel.from_pretrained(
     trust_remote_code=True,
     use_safetensors=True,
 )
-model = model.eval().to(torch.bfloat16)
 @spaces.GPU

     trust_remote_code=True,
     use_safetensors=True,
 )
+model = model.eval().cuda().to(torch.bfloat16)
 @spaces.GPU