vix.ing · top · new · best · stats · spec

APEX-Agents

2026/01/20 by Bertie Vidgen, Austin Mann, Abby Fennelly +21 · 2 voices
Computer Science · #cs.AI #cs.CL #cs.LG

paper · pdf · doi:10.48550/arxiv.2601.14242

arxiv published 2026/01/20 · arxiv updated 2026/02/23

Abstract

We introduce the AI Productivity Index for Agents (APEX-Agents), a benchmark for assessing whether AI agents can execute long-horizon, cross-application tasks created by investment banking analysts, management consultants, and corporate lawyers. APEX-Agents requires agents to navigate realistic work environments with files and tools. We test eight agents for the leaderboard using Pass@1. Gemini 3 Flash (Thinking=High) achieves the highest score of 24.0%, followed by GPT-5.2 (Thinking=High), Claude Opus 4.5 (Thinking=High), and Gemini 3 Pro (Thinking=High). We open source the APEX-Agents benchmark (n=480) with all prompts, rubrics, gold outputs, files, and metadata. We also open source Archipelago, our infrastructure for agent execution and evaluation.

Discussions