Loading…
Glossary term
A benchmark of very hard, expert-level questions across many fields.
Humanity's Last Exam is a collection of very hard questions written by experts across many fields, built to stay challenging after other benchmarks became saturated. Answers can be checked automatically.
Models score far below perfect, though scores have been climbing.
It was created to measure progress at the frontier when older tests were too easy.