IBM Research

company

https://research.ibm.com/

AI & ML interests

Enterprise AI and ML, Foundation Models, Responsible AI

Recent Activity

Vatche published an article about 3 hours ago

Your Agent Aced the Task. Will It Do It Again?

ankita-naik published a dataset about 23 hours ago

ibm-research/VAKRA-GatedTest

ankita-naik updated a dataset 1 day ago

ibm-research/VAKRA-GatedTest

View all activity

Papers

DRACO: Fine-Grained Credit Assignment with Dynamic Rubrics for Long-Horizon Agent Training

Evoflux: Inference-Time Evolution of Executable Tool Workflows for Compact Agents

View all Papers

Articles

Your Agent Aced the Task. Will It Do It Again?

about 3 hours ago

IBM releases SOTA Granite Time Series PatchTST-FM-r2 model with commercial-friendly license

Real-Time Intelligence with IBM Time Series Models on Confluent

How Much Memory Does Your Agent Actually Need?

Thinking of ACE? We Can Do It with Fewer Tokens

Model Routing Is Simple. Until It Isn’t.

ScarfBench: Benchmarking AI Agents for Enterprise Java Framework Migration

Build real agentic apps using CUGA: two dozen working examples on a lightweight harness

Beyond LLMs: Why Scalable Enterprise AI Adoption Depends on Agent Logic

ITBench-AA: Frontier Models Score Below 50% on the First Benchmark for Agentic Enterprise IT Tasks — by Artificial Analysis and IBM

The Open Agent Leaderboard

Inside VAKRA: Reasoning, Tool Use, and Failure Modes of Agents

ALTK‑Evolve: On‑the‑Job Learning for AI Agents

IBM and UC Berkeley Diagnose Why Enterprise Agents Fail Using IT-Bench and MAST

AssetOpsBench: Bridging the Gap Between AI Agent Benchmarks and Industrial Reality

CUGA on Hugging Face: Democratizing Configurable AI Agents

View all articles

ibm-research 's datasets 105

ibm-research/VAKRA

Viewer • Updated about 23 hours ago • 1.8k • 1.76k • 46

ibm-research/VAKRA-GatedTest

Updated 1 day ago • 18

ibm-research/LLMFineTuningBench

Viewer • Updated 8 days ago • 30.9k • 105 • 3

ibm-research/SI-Cyber

Updated 16 days ago • 91

ibm-research/dp-bench

Updated 20 days ago • 84 • 1

ibm-research/lmcache-agentic-traces_Otel

Viewer • Updated about 1 month ago • 767 • 108

ibm-research/codex_swebenchpro_traces_Otel

Preview • Updated Aug 5 • 229

ibm-research/gb-bash-1step-out_j2id8zjb

Viewer • Updated Jul 24 • 1 • 16

ibm-research/gb-bash-1step-out_bzsfbaex

Viewer • Updated Jul 22 • 1 • 16

ibm-research/AIX360-CEM-MAF-data

Viewer • Updated Jul 16 • 10 • 167

ibm-research/synthetic-conversations-traces

Viewer • Updated Jul 14 • 720 • 45

ibm-research/STaD

Viewer • Updated Jul 8 • 1.01k • 47 • 2

ibm-research/Auto-BenchmarkCard

Viewer • Updated Jun 24 • 105 • 2.14k • 3

ibm-research/AssetOpsBench

Viewer • Updated May 28 • 467 • 794 • 46

ibm-research/ScarfBench

Updated May 22 • 478 • 19

ibm-research/WikiVQABench

Viewer • Updated May 21 • 344 • 60 • 6

ibm-research/LLM_Fine-Tuning_Performance

Preview • Updated May 15 • 60 • 2

ibm-research/AITQARetrieval

Viewer • Updated May 10 • 3.99k • 107

ibm-research/cif-dataset

Viewer • Updated May 7 • 301k • 1.66k • 8

ibm-research/hemolab-bench

Viewer • Updated May 6 • 49.7k • 30 • 2

ibm-research/MermaidSeqBench

Viewer • Updated May 6 • 132 • 116 • 7

ibm-research/ITBench-Lite

Updated Apr 21 • 1.75k • 14

ibm-research/data-product-benchmark

Viewer • Updated Mar 18 • 33.2k • 3.1k • 3

ibm-research/900K-Judgements

Viewer • Updated Mar 18 • 939k • 148 • 6

ibm-research/VAREX

Viewer • Updated Mar 18 • 1.78k • 1.4k • 7

ibm-research/BPO-Bench

Preview • Updated Mar 17 • 86 • 1

ibm-research/watsonxDocsQA

Viewer • Updated Mar 10 • 1.22k • 147 • 5

ibm-research/flow-bench

Viewer • Updated Mar 9 • 546 • 8 • 2

ibm-research/FailureSensorIQ

Viewer • Updated Feb 24 • 8.3k • 251 • 9

ibm-research/WatsonxDocsQARetrieval

Viewer • Updated Feb 17 • 1.2k • 33