Hugging Face's logo

Spaces:
macadeliccc
/
liquid_ai_chatbot
Running on Zero

App Files Community
macadeliccc commited on
Commit
3a44bb8
·
verified ·
1 Parent(s): 1da7e11

Update app.py

Browse files
Files changed (1) hide show
  1. app.py +1 -1
app.py CHANGED
@@ -30,7 +30,7 @@ def predict(message, history):
30
  model = AutoModelForCausalLM.from_pretrained(
31
  "macadeliccc/SOLAR-math-2x10.7b",
32
  torch_dtype="auto",
33
- load_in_8bit=True,
34
  trust_remote_code=True
35
  )
36
  history_transformer_format = history + [[message, ""]]
 
30
  model = AutoModelForCausalLM.from_pretrained(
31
  "macadeliccc/SOLAR-math-2x10.7b",
32
  torch_dtype="auto",
33
+ load_in_4bit=True,
34
  trust_remote_code=True
35
  )
36
  history_transformer_format = history + [[message, ""]]