Spaces:
Running
on
CPU Upgrade
Running
on
CPU Upgrade
tasks descriptions
Browse files- src/about.py +24 -22
src/about.py
CHANGED
|
@@ -70,28 +70,30 @@ or join our [Discord SpeakLeash](https://discord.gg/3G9DVM39)
|
|
| 70 |
* add inference time
|
| 71 |
* add metadata for models (e.g. #Params)
|
| 72 |
* add more tasks
|
| 73 |
-
*
|
| 74 |
-
|
| 75 |
-
##
|
| 76 |
-
|
| 77 |
-
|
| 78 |
-
|
| 79 |
-
|
| 80 |
-
-
|
| 81 |
-
-
|
| 82 |
-
-
|
| 83 |
-
-
|
| 84 |
-
|
| 85 |
-
|
| 86 |
-
|
| 87 |
-
-
|
| 88 |
-
-
|
| 89 |
-
|
| 90 |
-
|
| 91 |
-
|
| 92 |
-
|
| 93 |
-
|
| 94 |
-
|
|
|
|
|
|
|
| 95 |
|
| 96 |
|
| 97 |
## Reproducibility
|
|
|
|
| 70 |
* add inference time
|
| 71 |
* add metadata for models (e.g. #Params)
|
| 72 |
* add more tasks
|
| 73 |
+
* use model templates
|
| 74 |
+
|
| 75 |
+
## Tasks
|
| 76 |
+
|
| 77 |
+
| Task | Dataset | Metric | Type |
|
| 78 |
+
|---------------------------------|---------------------------------------|-----------|-----------------|
|
| 79 |
+
| belebele_pol_Latn | facebook/belebele | accuracy | multiple_choice |
|
| 80 |
+
| polemo2_in | allegro/klej-polemo2-in | accuracy | generate_until |
|
| 81 |
+
| polemo2_in_multiple_choice | allegro/klej-polemo2-in | accuracy | multiple_choice |
|
| 82 |
+
| polemo2_out | allegro/klej-polemo2-out | accuracy | generate_until |
|
| 83 |
+
| polemo2_out_multiple_choice | allegro/klej-polemo2-out | accuracy | multiple_choice |
|
| 84 |
+
| polish_8tags_multiple_choice | sdadas/8tags | accuracy | multiple_choice |
|
| 85 |
+
| polish_8tags_regex | sdadas/8tags | accuracy | generate_until |
|
| 86 |
+
| polish_belebele_regex | facebook/belebele | accuracy | generate_until |
|
| 87 |
+
| polish_dyk_multiple_choice | allegro/klej-dyk | binary F1 | multiple_choice |
|
| 88 |
+
| polish_dyk_regex | allegro/klej-dyk | binary F1 | generate_until |
|
| 89 |
+
| polish_ppc_multiple_choice | sdadas/ppc | accuracy | multiple_choice |
|
| 90 |
+
| polish_ppc_regex | sdadas/ppc | accuracy | generate_until |
|
| 91 |
+
| polish_psc_multiple_choice | allegro/klej-psc | binary F1 | multiple_choice |
|
| 92 |
+
| polish_psc_regex | allegro/klej-psc | binary F1 | generate_until |
|
| 93 |
+
| polish_cbd_multiple_choice | ptaszynski/PolishCyberbullyingDataset | macro F1 | multiple_choice |
|
| 94 |
+
| polish_cbd_regex | ptaszynski/PolishCyberbullyingDataset | macro F1 | generate_until |
|
| 95 |
+
| polish_klej_ner_multiple_choice | allegro/klej-nkjp-ner | accuracy | multiple_choice |
|
| 96 |
+
| polish_klej_ner_regex | allegro/klej-nkjp-ner | accuracy | generate_until |
|
| 97 |
|
| 98 |
|
| 99 |
## Reproducibility
|