Update index.html
Browse files- index.html +12 -5
index.html
CHANGED
|
@@ -110,8 +110,9 @@
|
|
| 110 |
<ul>
|
| 111 |
<li><strong>June 1, 2025</strong>: Official announcement</li>
|
| 112 |
<li><strong>June 10, 2025</strong>: Release of training data, dev set, phonetizer, baselines</li>
|
| 113 |
-
<li><strong>July
|
| 114 |
-
<li><strong>July
|
|
|
|
| 115 |
<li><strong>July 30, 2025</strong>: Final results released</li>
|
| 116 |
<li><strong>August 15, 2025</strong>: System description papers due</li>
|
| 117 |
<li><strong>August 22, 2025</strong>: Notification of acceptance</li>
|
|
@@ -228,8 +229,8 @@ ID,Labels
|
|
| 228 |
|
| 229 |
<h2>Evaluation Criteria</h2>
|
| 230 |
<p>
|
| 231 |
-
Leaderboard based on phoneme-level F1-score
|
| 232 |
-
We use a hierarchical evaluation (detection + diagnostic) per
|
| 233 |
</p>
|
| 234 |
<ul>
|
| 235 |
<li><em>What is said</em>: annotated phoneme sequence</li>
|
|
@@ -267,7 +268,13 @@ ID,Labels
|
|
| 267 |
|
| 268 |
<h2>Future Updates</h2>
|
| 269 |
<p>
|
| 270 |
-
Detailed scoring weights, submission templates, and clarifications will be posted on the shared task site
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 271 |
</p>
|
| 272 |
|
| 273 |
<h2>References</h2>
|
|
|
|
| 110 |
<ul>
|
| 111 |
<li><strong>June 1, 2025</strong>: Official announcement</li>
|
| 112 |
<li><strong>June 10, 2025</strong>: Release of training data, dev set, phonetizer, baselines</li>
|
| 113 |
+
<li><strong>July 20, 2025</strong>: Registration deadline</li>
|
| 114 |
+
<li><strong>July 24, 2025</strong>: QuranMB test data release</li>
|
| 115 |
+
<li><strong>July 29, 2025</strong>: Test set submission closes</li>
|
| 116 |
<li><strong>July 30, 2025</strong>: Final results released</li>
|
| 117 |
<li><strong>August 15, 2025</strong>: System description papers due</li>
|
| 118 |
<li><strong>August 22, 2025</strong>: Notification of acceptance</li>
|
|
|
|
| 229 |
|
| 230 |
<h2>Evaluation Criteria</h2>
|
| 231 |
<p>
|
| 232 |
+
IqraEval Leaderboard is based on phoneme-level <strong>F1-score</strong>.
|
| 233 |
+
We use a hierarchical evaluation (detection + diagnostic) per <a href="https://arxiv.org/pdf/2310.13974" target="_blank">MDD Overview</a>.
|
| 234 |
</p>
|
| 235 |
<ul>
|
| 236 |
<li><em>What is said</em>: annotated phoneme sequence</li>
|
|
|
|
| 268 |
|
| 269 |
<h2>Future Updates</h2>
|
| 270 |
<p>
|
| 271 |
+
Detailed scoring weights, submission templates, and clarifications will be posted on the shared task site (June 15, 2025).
|
| 272 |
+
</p>
|
| 273 |
+
|
| 274 |
+
<h2>Contact and Support</h2>
|
| 275 |
+
<p>
|
| 276 |
+
For inquiries and support, reach out to the task coordinators at
|
| 277 |
+
<a href="mailto:iqraeval@googlegroups.com">iqraeval@googlegroups.com</a>.
|
| 278 |
</p>
|
| 279 |
|
| 280 |
<h2>References</h2>
|