Spaces:
Running
Running
Commit
·
a74444e
1
Parent(s):
5e92e3d
Update model addition instructions after re-factor
Browse files
README.md
CHANGED
|
@@ -51,20 +51,20 @@ If you are from outside of HPAI you must directly modify the `results/results_ic
|
|
| 51 |
|
| 52 |
If you are from HPAI, you can add your model onto our shared `.csv` file of results and follow these steps:
|
| 53 |
|
| 54 |
-
1. Modify the `
|
| 55 |
|
| 56 |
For example, if we wish to include the classic GPT2 model, we would add the following metadata:
|
| 57 |
|
| 58 |
```python
|
| 59 |
-
|
| 60 |
-
|
| 61 |
...
|
| 62 |
|
| 63 |
-
"GPT2": (
|
| 64 |
-
"https://huggingface.co/openai-community/gpt2",
|
| 65 |
-
0.13,
|
| 66 |
-
"Coding",
|
| 67 |
-
"V1",
|
|
|
|
| 68 |
),
|
| 69 |
}
|
| 70 |
```
|
|
|
|
| 51 |
|
| 52 |
If you are from HPAI, you can add your model onto our shared `.csv` file of results and follow these steps:
|
| 53 |
|
| 54 |
+
1. Modify the `config/model_metadata.py` file, `MODELS` dictionary to include a new entry for your model
|
| 55 |
|
| 56 |
For example, if we wish to include the classic GPT2 model, we would add the following metadata:
|
| 57 |
|
| 58 |
```python
|
| 59 |
+
MODELS = {
|
|
|
|
| 60 |
...
|
| 61 |
|
| 62 |
+
"GPT2": ModelMetadata(
|
| 63 |
+
"https://huggingface.co/openai-community/gpt2", # model url
|
| 64 |
+
0.13, # params (in B)
|
| 65 |
+
"Coding", # model type: "General", "Coding", or "RTL-Specific"
|
| 66 |
+
"V1", # release of the TuRTLe Leaderboard: "V1", "V2", or "V3"
|
| 67 |
+
"Dense" # model architecture: "Dense" or "Reasoning"
|
| 68 |
),
|
| 69 |
}
|
| 70 |
```
|