Spaces:
Runtime error
Runtime error
Fix URLs
Browse files- .github/workflows/sync_with_spaces.yml +1 -1
- README.md +26 -10
- app.py +2 -2
.github/workflows/sync_with_spaces.yml
CHANGED
|
@@ -17,4 +17,4 @@ jobs:
|
|
| 17 |
env:
|
| 18 |
HF_TOKEN: ${{ secrets.HF_TOKEN }}
|
| 19 |
run: |
|
| 20 |
-
git push https://lewtun:$HF_TOKEN@huggingface.co/spaces/autoevaluate/
|
|
|
|
| 17 |
env:
|
| 18 |
HF_TOKEN: ${{ secrets.HF_TOKEN }}
|
| 19 |
run: |
|
| 20 |
+
git push https://lewtun:$HF_TOKEN@huggingface.co/spaces/autoevaluate/model-evaluator main
|
README.md
CHANGED
|
@@ -8,7 +8,7 @@ sdk_version: 1.10.0
|
|
| 8 |
app_file: app.py
|
| 9 |
---
|
| 10 |
|
| 11 |
-
#
|
| 12 |
|
| 13 |
> Submit evaluation jobs to AutoTrain from the Hugging Face Hub
|
| 14 |
|
|
@@ -16,12 +16,28 @@ app_file: app.py
|
|
| 16 |
|
| 17 |
The table below shows which tasks are currently supported for evaluation in the AutoTrain backend:
|
| 18 |
|
| 19 |
-
| Task
|
| 20 |
-
|
| 21 |
-
| `binary_classification`
|
| 22 |
-
| `multi_class_classification`
|
| 23 |
-
| `multi_label_classification`
|
| 24 |
-
| `entity_extraction`
|
| 25 |
-
| `extractive_question_answering`
|
| 26 |
-
| `translation`
|
| 27 |
-
| `summarization`
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 8 |
app_file: app.py
|
| 9 |
---
|
| 10 |
|
| 11 |
+
# Model Evaluator
|
| 12 |
|
| 13 |
> Submit evaluation jobs to AutoTrain from the Hugging Face Hub
|
| 14 |
|
|
|
|
| 16 |
|
| 17 |
The table below shows which tasks are currently supported for evaluation in the AutoTrain backend:
|
| 18 |
|
| 19 |
+
| Task | Supported |
|
| 20 |
+
|:-----------------------------------|:---------:|
|
| 21 |
+
| `binary_classification` | β
|
|
| 22 |
+
| `multi_class_classification` | β
|
|
| 23 |
+
| `multi_label_classification` | β |
|
| 24 |
+
| `entity_extraction` | β
|
|
| 25 |
+
| `extractive_question_answering` | β
|
|
| 26 |
+
| `translation` | β
|
|
| 27 |
+
| `summarization` | β
|
|
| 28 |
+
| `image_binary_classification` | β
|
|
| 29 |
+
| `image_multi_class_classification` | β
|
|
| 30 |
+
|
| 31 |
+
## Installation
|
| 32 |
+
|
| 33 |
+
To run the application, first clone this repository and install the dependencies as follows:
|
| 34 |
+
|
| 35 |
+
```
|
| 36 |
+
pip install -r requirements.txt
|
| 37 |
+
```
|
| 38 |
+
|
| 39 |
+
Then spin up the application by running:
|
| 40 |
+
|
| 41 |
+
```
|
| 42 |
+
streamlit run app.py
|
| 43 |
+
```
|
app.py
CHANGED
|
@@ -161,7 +161,7 @@ is_valid_dataset = http_get(
|
|
| 161 |
if is_valid_dataset["valid"] is False:
|
| 162 |
st.error(
|
| 163 |
"""The dataset you selected is not currently supported. Open a \
|
| 164 |
-
[discussion](https://huggingface.co/spaces/autoevaluate/
|
| 165 |
)
|
| 166 |
|
| 167 |
metadata = get_metadata(selected_dataset)
|
|
@@ -176,7 +176,7 @@ with st.expander("Advanced configuration"):
|
|
| 176 |
SUPPORTED_TASKS,
|
| 177 |
index=SUPPORTED_TASKS.index(metadata[0]["task_id"]) if metadata is not None else 0,
|
| 178 |
help="""Don't see your favourite task here? Open a \
|
| 179 |
-
[discussion](https://huggingface.co/spaces/autoevaluate/
|
| 180 |
)
|
| 181 |
# Select config
|
| 182 |
configs = get_dataset_config_names(selected_dataset)
|
|
|
|
| 161 |
if is_valid_dataset["valid"] is False:
|
| 162 |
st.error(
|
| 163 |
"""The dataset you selected is not currently supported. Open a \
|
| 164 |
+
[discussion](https://huggingface.co/spaces/autoevaluate/model-evaluator/discussions) for support."""
|
| 165 |
)
|
| 166 |
|
| 167 |
metadata = get_metadata(selected_dataset)
|
|
|
|
| 176 |
SUPPORTED_TASKS,
|
| 177 |
index=SUPPORTED_TASKS.index(metadata[0]["task_id"]) if metadata is not None else 0,
|
| 178 |
help="""Don't see your favourite task here? Open a \
|
| 179 |
+
[discussion](https://huggingface.co/spaces/autoevaluate/model-evaluator/discussions) to request it!""",
|
| 180 |
)
|
| 181 |
# Select config
|
| 182 |
configs = get_dataset_config_names(selected_dataset)
|