Update README.md
Browse files
README.md
CHANGED
|
@@ -39,6 +39,7 @@ We provide two versions:
|
|
| 39 |
| Winogrande (5-shot)| 77.98 | 76.24 | 76.48 | 76.4 | 76.64 |
|
| 40 |
| GSM8K (5-shot) | 75.44 | 71.27 | 75.36 | 73.47 | 72.25 |
|
| 41 |
| Average | 69.51 | 68.00 | <b>69.02</b> | 67.67 | 68.23 |
|
|
|
|
| 42 |
|
| 43 |
You can reproduce the results above via `pip install lm-eval==0.4.3`
|
| 44 |
|
|
|
|
| 39 |
| Winogrande (5-shot)| 77.98 | 76.24 | 76.48 | 76.4 | 76.64 |
|
| 40 |
| GSM8K (5-shot) | 75.44 | 71.27 | 75.36 | 73.47 | 72.25 |
|
| 41 |
| Average | 69.51 | 68.00 | <b>69.02</b> | 67.67 | 68.23 |
|
| 42 |
+
| Relative performance | 100% | 97.83% | <b>99.3%</b> | 97.35% | 98.16% |
|
| 43 |
|
| 44 |
You can reproduce the results above via `pip install lm-eval==0.4.3`
|
| 45 |
|