Update README.md
Browse files
README.md
CHANGED
|
@@ -124,6 +124,11 @@ model-index:
|
|
| 124 |
|
| 125 |
# This model was built to shorten text that is injected into LLM prompts to reduce API calling costs
|
| 126 |
Very high compression (7x+) meaning the text is 7 times smaller when sent to your LLM provider!
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 127 |
<Gallery />
|
| 128 |
|
| 129 |
https://api.wandb.ai/links/shorecode-shorecode-llc/6udfudmr
|
|
|
|
| 124 |
|
| 125 |
# This model was built to shorten text that is injected into LLM prompts to reduce API calling costs
|
| 126 |
Very high compression (7x+) meaning the text is 7 times smaller when sent to your LLM provider!
|
| 127 |
+
Recommended kwargs:
|
| 128 |
+
- num_beams=2 || 3
|
| 129 |
+
- no_repeat_ngram_size=2
|
| 130 |
+
- min_length=20
|
| 131 |
+
- max_new_tokens=500 || as high as you can tolerate, 4x500 = 2000 characters. anything after 2000 is clipped
|
| 132 |
<Gallery />
|
| 133 |
|
| 134 |
https://api.wandb.ai/links/shorecode-shorecode-llc/6udfudmr
|