Spaces:
Running
on
CPU Upgrade
Running
on
CPU Upgrade
| # HTML title for the application | |
| TITLE = """<h1 align="center" id="space-title">FAIR Chemistry Leaderboard</h1>""" | |
| # Main introduction text | |
| INTRODUCTION_TEXT = """ | |
| # Welcome to the FAIR Chemistry Leaderboard! π§ͺ | |
| This space hosts comprehensive leaderboards across different chemical domains including molecules, catalysts, and materials. | |
| *Note: Leaderboards previously hosted on EvalAI (such as [OC20](https://eval.ai/web/challenges/challenge-page/712/overview)) will be migrated here in the near future.* | |
| ## 𧬠OMol25 | |
| This leaderboard evaluates performance on the **Open Molecules 2025 (OMol25)** datasetβa diverse, high-quality collection that uniquely combines elemental, chemical, and structural diversity. | |
| π **Learn more:** [OMol25 Paper](https://arxiv.org/pdf/2505.08762) | |
| ### Benchmarks | |
| **S2EF (Structure to Energy and Forces)** | |
| - Test and validation sets across different molecular categories | |
| **Evaluations.** Downstream chemistry tasks that evaluate practical applications: | |
| - **Ligand Pocket:** Protein-ligand interaction energy as a proxy for binding energy | |
| - **Ligand Strain:** Ligand-strain energy crucial for understanding protein-ligand binding | |
| - **Conformers:** Identifying the lowest energy conformer | |
| - **Protonation:** Energy differences between protonated structures (proxy for pKa prediction) | |
| - **Distance Scaling:** Short and long range intermolecular interactions | |
| - **IE/EA:** Ionization energy and electron affinity | |
| - **Spin Gap:** Energy differences between varying spin states | |
| ## π Getting Started | |
| Ready to submit your model? Check out our steps for running benchmarks and generating prediction files: | |
| π **[Submission Documentation](https://fair-chem.github.io/molecules/leaderboard.html)** | |
| """ | |
| # Submission instructions | |
| SUBMISSION_TEXT = """ | |
| ## How to Submit | |
| ### To submit your model predictions: | |
| - **π Step 1:** Generate prediction files for the appropriate task (see [here](https://fair-chem.github.io/molecules/leaderboard.html) for details) | |
| - **π Step 2:** Sign in with Hugging Face | |
| - **π Step 3:** Fill in the submission metadata (name, organization, contact info, etc.) | |
| - **π― Step 4:** Select the evaluation type that matches your prediction file | |
| - **π€ Step 5:** Upload your file and click Submit Eval | |
| - **β±οΈ Step 6:** Wait for the evaluation to complete and see the "β " message in the Status bar | |
| **π Submission Limits:** Users are limited to **5 successful submissions per month** for each evaluation type. | |
| ### β οΈ Important Notes: | |
| - β **File Format:** Ensure your prediction file format matches the expected format for the selected evaluation (.npz for S2EF and .json for Evaluations) | |
| - π **Privacy:** Your email will be stored privately and only used for communication regarding your submission | |
| - π **Results:** Results will appear on the leaderboard after successful validation | |
| - β±οΈ **Wait Time:** Remain on the page until you see the "Success" message. Evaluations can take several minutes, please be patient | |
| - ποΈ **Removal:** If you wish to have your model removed from the leaderboard, please reach out to mshuaibi@meta.com with the model name and submission date | |
| ### π¬ Need Help? | |
| This leaderboard is actively being developed and we welcome any feedback and contributions! | |
| **π Contact us:** | |
| - π [GitHub Issues](https://github.com/facebookresearch/fairchem) | |
| - π¬ [Discussion Forum](https://huggingface.co/spaces/facebook/fairchem_leaderboard/discussions) | |
| """ | |
| # Citation information | |
| CITATION_BUTTON_LABEL = "Copy the following snippet to cite these results" | |
| CITATION_BUTTON_TEXT = r""" | |
| ```latex | |
| @article{levine2025open, | |
| title={The open molecules 2025 (omol25) dataset, evaluations, and models}, | |
| author={Levine, Daniel S and Shuaibi, Muhammed and Spotte-Smith, Evan Walter Clark and Taylor, Michael G and Hasyim, Muhammad R and Michel, Kyle and Batatia, Ilyes and Cs{'a}nyi, G{'a}bor and Dzamba, Misko and Eastman, Peter and others}, | |
| journal={arXiv preprint arXiv:2505.08762}, | |
| year={2025} | |
| } | |
| ``` | |
| """ | |
| # Table configuration | |
| PRE_COLUMN_NAMES = ["Model", "Organization", "Energy Conserving", "Training Set"] | |
| POST_COLUMN_NAMES = ["Submission date"] | |
| TYPES = ["markdown", "str", "bool", "str"] | |
| def model_hyperlink(model_link: str, paper_link: str, model_name: str) -> str: | |
| """Create a hyperlink for model names in the leaderboard.""" | |
| # Check if we have valid links | |
| has_model_link = model_link and model_link.strip() != "" | |
| has_paper_link = paper_link and paper_link.strip() != "" | |
| if not has_model_link and not has_paper_link: | |
| return model_name | |
| if has_model_link and not has_paper_link: | |
| return f'<a target="_blank" href="{model_link}" style="color: var(--link-text-color); text-decoration: underline;text-decoration-style: dotted;" title="Download model">{model_name}</a>' | |
| if not has_model_link and has_paper_link: | |
| return f'{model_name} <a target="_blank" href="{paper_link}" style="color: var(--link-text-color); text-decoration: underline;text-decoration-style: dotted;" title="Read paper">π</a>' | |
| return f'<a target="_blank" href="{model_link}" style="color: var(--link-text-color); text-decoration: underline;text-decoration-style: dotted;" title="Download model">{model_name}</a> <a target="_blank" href="{paper_link}" style="color: var(--link-text-color); text-decoration: underline;text-decoration-style: dotted;" title="Read paper">π</a>' | |