brief research
IBM benchmarks agents on Java migration
IBM Research's ScarfBench evaluates AI agents on enterprise Java framework migration, one of the highest-volume real-world uses of coding agents.
IBM Research published ScarfBench on June 30, a benchmark testing AI agents on enterprise Java framework migration tasks rather than greenfield coding puzzles.
sources 1 cited
1 huggingface.co ScarfBench: Benchmarking AI Agents for Enterprise Java Framework Migration