Update src/tasks_content.py
Browse files- src/tasks_content.py +4 -3
src/tasks_content.py
CHANGED
|
@@ -69,10 +69,11 @@ TASKS_DESCRIPTIONS = {
|
|
| 69 |
|
| 70 |
"bug_localization": """# Bug Localization\n
|
| 71 |
|
| 72 |
-
Our
|
|
|
|
|
|
|
|
|
|
| 73 |
|
| 74 |
-
Moreover, 150 data points from the test split were manually verified and can be used for bug localization approaches evaluation.
|
| 75 |
-
We used information retrieval metrics such as R@k, P@k and F1-score for evaluation, taking k equal to 1 and 2.
|
| 76 |
""",
|
| 77 |
|
| 78 |
"module_summarization": """# Module Summarization\n
|
|
|
|
| 69 |
|
| 70 |
"bug_localization": """# Bug Localization\n
|
| 71 |
|
| 72 |
+
Our Bug Localization benchmark 🤗 [JetBrains-Research/lca-bug-localization](https://huggingface.co/datasets/JetBrains-Research/lca-bug-localization) includes 150 manually verified bug issue descriptions with information about pull request that fix them for Python, Java and Kotlin projects.
|
| 73 |
+
We used information retrieval metrics such as R@k, P@k, F1-score and MAP for evaluation, taking k equal to 1 and 2.
|
| 74 |
+
|
| 75 |
+
For further details on the dataset and the baselines from 🏟️ Long Code Arena Team, refer to `bug_localization` folder in [our baselines repository](https://github.com/JetBrains-Research/lca-baselines/blob/main/bug_localization/).
|
| 76 |
|
|
|
|
|
|
|
| 77 |
""",
|
| 78 |
|
| 79 |
"module_summarization": """# Module Summarization\n
|