ProX Dataset a collection of pre-training corpora refined by ProX gair-prox/DCLM-pro Viewer • Updated Feb 15, 2025 • 366M • 5.23k • 11 gair-prox/FineWeb-pro Viewer • Updated Sep 26, 2024 • 63.1M • 1.36k • 26 gair-prox/open-web-math-pro Viewer • Updated Sep 26, 2024 • 2.58M • 393 • 12 gair-prox/RedPajama-pro Viewer • Updated Sep 26, 2024 • 10.2M • 228 • 4
ProX Math Models base models trained on ProX curated openwebmath-pro. gair-prox/Mistral-7B-ProXMath Text Generation • 7B • Updated Sep 28, 2024 • 10 • 3 gair-prox/TinyLlama-1.1B-ProXMath 1B • Updated Oct 10, 2024 • 15 • 2 gair-prox/Llama-2-7B-ProXMath Text Generation • Updated Oct 10, 2024 • 13 • 1 gair-prox/CodeLlama-7B-ProXMath Updated Oct 10, 2024 • 11 • 1
ProX Refining Models Adapted small language models used to generate data refining programs gair-prox/web-doc-refining-lm Text Generation • 0.4B • Updated Oct 10, 2024 • 11 • 5 gair-prox/web-chunk-refining-lm Text Generation • 0.4B • Updated Oct 10, 2024 • 90 • 6 gair-prox/math-doc-refining-lm Text Generation • 0.8B • Updated Oct 10, 2024 • 3 • 2 gair-prox/math-chunk-refining-lm Text Generation • 0.4B • Updated Oct 10, 2024 • 2 • 1
ProX General Models base models trained on ProX curated data. gair-prox/FW-ProX-1.7B Text Generation • 2B • Updated Sep 28, 2024 • 5 • 4 gair-prox/RedPJ-ProX-0.7B 0.8B • Updated Oct 10, 2024 • 7 • 1 gair-prox/ProX-RedPJ-1.7B-25B 2B • Updated Sep 16, 2024 • 5 gair-prox/RedPJ-ProX-0.3B 0.4B • Updated Oct 10, 2024 • 21 • 3
ProX Dataset a collection of pre-training corpora refined by ProX gair-prox/DCLM-pro Viewer • Updated Feb 15, 2025 • 366M • 5.23k • 11 gair-prox/FineWeb-pro Viewer • Updated Sep 26, 2024 • 63.1M • 1.36k • 26 gair-prox/open-web-math-pro Viewer • Updated Sep 26, 2024 • 2.58M • 393 • 12 gair-prox/RedPajama-pro Viewer • Updated Sep 26, 2024 • 10.2M • 228 • 4
ProX Refining Models Adapted small language models used to generate data refining programs gair-prox/web-doc-refining-lm Text Generation • 0.4B • Updated Oct 10, 2024 • 11 • 5 gair-prox/web-chunk-refining-lm Text Generation • 0.4B • Updated Oct 10, 2024 • 90 • 6 gair-prox/math-doc-refining-lm Text Generation • 0.8B • Updated Oct 10, 2024 • 3 • 2 gair-prox/math-chunk-refining-lm Text Generation • 0.4B • Updated Oct 10, 2024 • 2 • 1
ProX Math Models base models trained on ProX curated openwebmath-pro. gair-prox/Mistral-7B-ProXMath Text Generation • 7B • Updated Sep 28, 2024 • 10 • 3 gair-prox/TinyLlama-1.1B-ProXMath 1B • Updated Oct 10, 2024 • 15 • 2 gair-prox/Llama-2-7B-ProXMath Text Generation • Updated Oct 10, 2024 • 13 • 1 gair-prox/CodeLlama-7B-ProXMath Updated Oct 10, 2024 • 11 • 1
ProX General Models base models trained on ProX curated data. gair-prox/FW-ProX-1.7B Text Generation • 2B • Updated Sep 28, 2024 • 5 • 4 gair-prox/RedPJ-ProX-0.7B 0.8B • Updated Oct 10, 2024 • 7 • 1 gair-prox/ProX-RedPJ-1.7B-25B 2B • Updated Sep 16, 2024 • 5 gair-prox/RedPJ-ProX-0.3B 0.4B • Updated Oct 10, 2024 • 21 • 3
