RESEARCHarXiv CS.LG·1d ago
MacArena: Benchmarking Computer Use Agents on an Online macOS Environment
MacArena is a new benchmark for computer-use agents (CUAs) operating graphical user interfaces (GUIs) on macOS, addressing the platform's underserved benchmarking landscape. It offers 421 verified tasks across 50 applications, running natively on Apple Silicon, to challenge CUAs beyond Linux-based benchmarks.
60