AI Leaderboards

Multitask language understanding across 14 disciplines — the harder, contamination-resistant successor to MMLU. 10-option multiple choice with stronger distractors.

PhD-level science questions in biology, physics, and chemistry, written by domain experts. The hardest subset of GPQA — humans with PhDs in the subject score ~65%.

OpenAI's 164 Python programming problems with hidden unit tests — the classic code-generation pass@1 benchmark.

Multi-language code edit benchmark — solve real Exercism problems across Python, JavaScript, Rust, Go, Java, C++ via edit-and-test loops.

American Invitational Mathematics Examination — competition math problems requiring multi-step reasoning. Reasoning-tier models score in the 90s; non-reasoning in the 50s.

Contamination-free code benchmark — only problems published AFTER a model's training cutoff. Refreshed monthly.

Massive Multi-discipline Multimodal Understanding — 11.5k college-level multimodal questions across 30 subjects (art, business, science, medicine, etc.).

Real GitHub-issue bug fixes that a human can verify, drawn from popular open-source Python repos.

Harder, contamination-resistant coding benchmark — average score is around 25%.

Long-horizon CLI workflows: shells, package managers, log parsing, debugging — every command an agent has to run.

General AI assistant: web browsing, file parsing, multi-modal reasoning, tool use across 450 unambiguous tasks.

Browser agents on realistic web tasks — e-commerce, social, CMS, code collaboration.