unsloth
/

Llama-3.2-11B-Vision-Instruct-bnb-4bit

text-generation-inference

4-bit precision

Model card Files Files and versions

Resources

View closed (1)

Strange behaviour of Llama3.2-vision - it behaves like text model

#9 opened 11 months ago by

How to use it in ollama

#8 opened 11 months ago by

Exporting to GGUF

#7 opened 11 months ago by

krasivayakoshka

Training with images

#6 opened 12 months ago by

AttributeError: Model MllamaForConditionalGeneration does not support BitsAndBytes quantization yet.

#5 opened 12 months ago by

How much vram needed?

#4 opened about 1 year ago by

How load this model?

#3 opened about 1 year ago by

Can you post the script that was used to quantize this model please?

#2 opened about 1 year ago by

ctranslate2-4you