SmolLM3 evaluation datasets - a HuggingFaceTB Collection

HuggingFaceTB 's Collections

SmolLM3 pretraining datasets

SmolLM3 evaluation datasets

Dolma LongAttn Graded

Reasoning datasets

SmolLM2

SmolVLM2 📺 Smallest video LM ever 🤏🏻

📚 LLM pretraining datasets

SmolVLM

🧩 SmolLM2 Intermediate Checkpoints

The Ultimate Collection of Code Classifiers

SmolVLM 256M & 500M

💻 Local SmolLMs

Instruct datasets

🌌 Cosmopedia

Find textbooks in FineWeb with a classifier

FineWeb clustering & synthetic generations

Other: Stanford, OpenStax, khanAcademy, wikihow...

FW generation prompts

Wikipedia Science topics

Wikipedia textbooks

SFT Experiments

Decay mixture experiments

SmolLM3 evaluation datasets

updated Jul 8

Datasets to decontaminate the post-training mixtures against. Use the subset and column values described per entry

Idavidrein/gpqa

Viewer • Updated Mar 28, 2024 • 1.25k • 48.4k • 238

Note Subset: gpqa_diamond Column: Question
HuggingFaceH4/aime_2024

Viewer • Updated Jan 26 • 30 • 30.9k • 51

Note Column: problem
MathArena/aime_2025

Viewer • Updated May 14 • 30 • 6.32k • 6

Note Column: problem
MathArena/hmmt_feb_2025

Viewer • Updated May 14 • 30 • 1.9k • 4

Note Column: problem
MathArena/usamo_2025

Viewer • Updated Apr 16 • 6 • 73 • 2

Note Column: problem
MathArena/brumo_2025

Viewer • Updated May 14 • 30 • 701 • 1

Note Column: problem
HuggingFaceH4/MATH-500

Viewer • Updated Nov 15, 2024 • 500 • 58.7k • 197

Note Column: problem
livecodebench/code_generation_lite

Updated Jun 5 • 64.8k • 72

Note Subsets: v4 & v4_v5 Column: question_content
lighteval/SimpleQA

Viewer • Updated Jan 28 • 4.33k • 658 • 2

Note Split: test Column: problem
edinburgh-dawg/mmlu-redux-2.0

Viewer • Updated Feb 25 • 5.7k • 4.92k • 30

Note Subsets: decontaminate against all 57. May be best to create a copy of the dataset and have a single `all` subset Column: question
facebook/Multi-IF

Viewer • Updated Oct 30, 2024 • 4.5k • 338 • 35

Note Column: turn_1_prompt (needs preprocessing)
openai/MMMLU

Viewer • Updated Oct 16, 2024 • 393k • 11.9k • 502

Note Subset: default Column: Question
TIGER-Lab/MMLU-Pro

Viewer • Updated 10 days ago • 12.1k • 56.5k • 392

Note Split: test