GEM benchmark

https://gem-benchmark.com

Activity Feed Request to join this org

AI & ML interests

We develop infrastructure for the evaluation of generated text.

GEM 's datasets 44

GEM/xlsum

Updated Oct 3, 2024 • 1.1k • 5

GEM/wiki_auto_asset_turk

Viewer • Updated May 29, 2024 • 510k • 592 • 8

GEM/gem

Updated Jan 18, 2024 • 4.26k • 33

GEM/opusparcus

Updated Jan 9, 2024 • 267 • 2

GEM/Augmented_CACAPO_for_E2E

Viewer • Updated Feb 26, 2023 • 47.3k • 43

GEM/CACAPO_E2E

Viewer • Updated Feb 26, 2023 • 20.1k • 44

GEM/Elongated_CACAPO_for_E2E

Updated Feb 26, 2023 • 32

GEM/xwikis

Updated Feb 22, 2023 • 951 • 4

GEM/wiki_lingua

Updated Feb 16, 2023 • 6.65k • 50

GEM/xmediasum

Viewer • Updated Feb 15, 2023 • 40k • 28 • 4

GEM/TaTA

Viewer • Updated Nov 3, 2022 • 8.69k • 30 • 1

GEM/FairytaleQA

Viewer • Updated Oct 25, 2022 • 10.6k • 195 • 9

GEM/squality

Updated Oct 25, 2022 • 34 • 2

GEM/xsum

Updated Oct 24, 2022 • 178 • 2

GEM/wiki_cat_sum

Viewer • Updated Oct 24, 2022 • 187k • 1k • 4

GEM/web_nlg

Viewer • Updated Oct 24, 2022 • 58.9k • 533 • 2

GEM/viggo

Viewer • Updated Oct 24, 2022 • 8.84k • 615 • 35

GEM/turku_hockey_data2text

Updated Oct 24, 2022 • 237

GEM/totto

Viewer • Updated Oct 24, 2022 • 138k • 482 • 2

GEM/surface_realisation_st_2020

Viewer • Updated Oct 24, 2022 • 351k • 729 • 1

GEM/squad_v2

Viewer • Updated Oct 24, 2022 • 142k • 176 • 3

GEM/sportsett_basketball

Viewer • Updated Oct 24, 2022 • 6.15k • 186 • 12

GEM/schema_guided_dialog

Viewer • Updated Oct 24, 2022 • 188k • 377 • 8

GEM/mlsum

Viewer • Updated Oct 24, 2022 • 535k • 85 • 2

GEM/mlb_data_to_text

Viewer • Updated Oct 24, 2022 • 26.2k • 80 • 3

GEM/e2e_nlg

Viewer • Updated Oct 24, 2022 • 38.4k • 301 • 1

GEM/dstc10_track2_task2

Updated Oct 24, 2022 • 32 • 4

GEM/dart

Viewer • Updated Oct 24, 2022 • 70.5k • 125

GEM/cs_restaurants

Viewer • Updated Oct 24, 2022 • 6.69k • 46 • 1

GEM/conversational_weather

Updated Oct 24, 2022 • 403 • 5