Update README.md
Browse files
README.md
CHANGED
|
@@ -47,6 +47,14 @@ Drawing strength from the FinTalk-19k and Alpaca dataset, a curated collection f
|
|
| 47 |
| FPB | 51.1 | 57.2 |
|
| 48 |
| **Cost**| **$2.67 Million** | **$27** |
|
| 49 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 50 |
|
| 51 |
## Model Usage
|
| 52 |
Experience the capabilities of the FinanceConnect model through a well-structured Python interface. To kick-start your exploration, follow the steps and snippets given below:
|
|
|
|
| 47 |
| FPB | 51.1 | 57.2 |
|
| 48 |
| **Cost**| **$2.67 Million** | **$27** |
|
| 49 |
|
| 50 |
+
| **Benchmark** | **FinanceConnect 13B** |
|
| 51 |
+
|--------------|--------------
|
| 52 |
+
| MMLU | 52.08 |
|
| 53 |
+
| ARC | 55.12 |
|
| 54 |
+
| HellaSwag | 77.73 |
|
| 55 |
+
| TruthfulQA | 38.80 |
|
| 56 |
+
| Winogrande | 71.82 |
|
| 57 |
+
| GSM8K | 1.6 |
|
| 58 |
|
| 59 |
## Model Usage
|
| 60 |
Experience the capabilities of the FinanceConnect model through a well-structured Python interface. To kick-start your exploration, follow the steps and snippets given below:
|