REAL-MM-RAG-Bench is a benchmark designed to evaluate multi-modal retrieval models under realistic and challenging conditions.
AI & ML interests
Enterprise AI and ML, Foundation Models, Responsible AI
Recent Activity
View all activity
Organization Card
IBM ❤️ Open Source AI
IBM is building enterprise-focused foundation models to drive the future of business.
We strongly believe in the power of collaboration and community-driven development to propel AI forward. As such, we will be hosting our latest open innovations from IBM Research in this Hugging Face organization. We hope that the AI community will find our efforts useful and that our models help fuel their research.
If you have any questions, please visit our discussions page.
This category highlights the collective efforts of the AI Automation team in advancing Industry 4.0 applications and exploring innovations beyond it.
-
AssetOpsBench: Benchmarking AI Agents for Task Automation in Industrial Asset Operations and Maintenance
Paper • 2506.03828 • Published • 15 -
FailureSensorIQ: A Multi-Choice QA Dataset for Understanding Sensor Relationships and Failure Modes
Paper • 2506.03278 • Published • 6 -
ibm-research/AssetOpsBench
Viewer • Updated • 141 • 1.47k • 5 -
1
AssetOpsBench
📉Evaluating Autonomous AI Agents for Industry 4.0 Tasks
REAL-MM-RAG-Bench is a benchmark designed to evaluate multi-modal retrieval models under realistic and challenging conditions.
This category highlights the collective efforts of the AI Automation team in advancing Industry 4.0 applications and exploring innovations beyond it.
-
AssetOpsBench: Benchmarking AI Agents for Task Automation in Industrial Asset Operations and Maintenance
Paper • 2506.03828 • Published • 15 -
FailureSensorIQ: A Multi-Choice QA Dataset for Understanding Sensor Relationships and Failure Modes
Paper • 2506.03278 • Published • 6 -
ibm-research/AssetOpsBench
Viewer • Updated • 141 • 1.47k • 5 -
1
AssetOpsBench
📉Evaluating Autonomous AI Agents for Industry 4.0 Tasks
spaces
8
pinned
Running
3
BlueBench Leaderboard
🥇
An open-source benchmark for enterprise use cases.
Running
1
AssetOpsBench
📉
Evaluating Autonomous AI Agents for Industry 4.0 Tasks
Running
1
SMI-TED-demo1
🦦
Generate embeddings from SMILES strings or CSV files
Sleeping
1
Fm4m Eval Demo
👁
Sleeping
4
FM4M-demo2
🐢
Generate and analyze molecular structures
Running
7
FM4M-demo1
🐢
Generate and analyze molecular structures
models
321
ibm-research/materials.selfies-ted
Feature Extraction
•
0.4B
•
Updated
•
19.4k
•
•
9
ibm-research/materials.mhg-ged
Feature Extraction
•
Updated
•
164
•
4
ibm-research/flowstate
9.07M
•
Updated
•
20.8k
•
4
ibm-research/biomed.dna.snp.modernbert.113m.v1
Updated
•
2
ibm-research/biomed.dna.ref.modernbert.113m.v1
Updated
ibm-research/biomed.rna.bert.110m.mlm.rda.v1
Updated
•
3
ibm-research/biomed.rna.bert.110m.mlm.multitask.v1
Updated
•
3
ibm-research/biomed.rna.bert.110m.wced.v1
Updated
•
3
ibm-research/biomed.rna.bert.110m.wced.multitask.v1
Updated
•
3
ibm-research/materials.pos-egnn
Graph Machine Learning
•
Updated
•
170
•
8
datasets
70
ibm-research/BFCL-FC-robustness
Updated
•
29
ibm-research/AssetOpsBench
Viewer
•
Updated
•
141
•
1.47k
•
5
ibm-research/FailureSensorIQ
Viewer
•
Updated
•
8.3k
•
93
•
3
ibm-research/SQL-API-Bench
Viewer
•
Updated
•
3.41k
•
204
•
3
ibm-research/MermaidSeqBench
Viewer
•
Updated
•
132
•
48
•
2
ibm-research/data-product-benchmark
Viewer
•
Updated
•
20.8k
•
120
•
2
ibm-research/fc-reward-bench
Viewer
•
Updated
•
1.5k
•
483
•
4
ibm-research/REAL-MM-RAG_TechReport_BEIR
Viewer
•
Updated
•
5.57k
•
624
ibm-research/REAL-MM-RAG_TechSlides_BEIR
Viewer
•
Updated
•
6.09k
•
591
ibm-research/REAL-MM-RAG_FinSlides_BEIR
Viewer
•
Updated
•
5.5k
•
612