Update src/tasks_content.py
Browse files- src/tasks_content.py +2 -1
src/tasks_content.py
CHANGED
|
@@ -46,6 +46,7 @@ TASKS_DESCRIPTIONS = {
|
|
| 46 |
* `medium-context`: 224 data points,
|
| 47 |
* `large-context`: 270 data points,
|
| 48 |
* `huge-context`: 296 data points.
|
|
|
|
| 49 |
Each data point contains the file for completion, a list of lines to complete with their categories (see the categorization below),
|
| 50 |
and a repository snapshot that can be used to build the context.
|
| 51 |
|
|
@@ -63,7 +64,7 @@ TASKS_DESCRIPTIONS = {
|
|
| 63 |
|
| 64 |
"commit_message_generation": """# Commit message generation\n
|
| 65 |
|
| 66 |
-
Our Commit message generation benchmark 🤗 [JetBrains-Research/lca-commit-message-generation](https://huggingface.co/datasets/JetBrains-Research/lca-commit-message-generation) includes 163 manually curated commits with large diffs from 34 Python projects.
|
| 67 |
|
| 68 |
We use the following metrics for evaluation:
|
| 69 |
* [BLEU](https://huggingface.co/spaces/evaluate-metric/sacrebleu)
|
|
|
|
| 46 |
* `medium-context`: 224 data points,
|
| 47 |
* `large-context`: 270 data points,
|
| 48 |
* `huge-context`: 296 data points.
|
| 49 |
+
|
| 50 |
Each data point contains the file for completion, a list of lines to complete with their categories (see the categorization below),
|
| 51 |
and a repository snapshot that can be used to build the context.
|
| 52 |
|
|
|
|
| 64 |
|
| 65 |
"commit_message_generation": """# Commit message generation\n
|
| 66 |
|
| 67 |
+
Our Commit message generation benchmark 🤗 [JetBrains-Research/lca-commit-message-generation](https://huggingface.co/datasets/JetBrains-Research/lca-commit-message-generation) includes 163 manually curated commits with large diffs from 34 Python projects, which the model needs to generate commit messages for.
|
| 68 |
|
| 69 |
We use the following metrics for evaluation:
|
| 70 |
* [BLEU](https://huggingface.co/spaces/evaluate-metric/sacrebleu)
|