← Claude Opus 4.8 · API · High effort (default)
Evidenceacceptedindependent_lab
Humanity's Last Exam
Artificial Analysis — HLE (Opus 4.8 max)
ev_2026_07_opus48_aa_hle
Result
45.74%
Confidence A
- Tested
- 2026-06-01
- Runs
- 1
Configuration
How it was measured
- Exact model
- claude-opus-4-8
- Reasoning
- max
- Agent harness
- none
- Tool access
- AA default
- Prompting
- AA HLE protocol
Independent AA HLE; frontier-relative norm under meth_v0_1_1.
Caveats
Known limitations
- Do not average with vendor tool-enabled HLE.
Weighting
Evidence weight factors
The engine weights each evidence row by these factors (0–1) when fusing scores — higher is more trusted.
relevance0.95
quality1.00
recency0.95
health0.90
comparability0.85
reliability0.85
Benchmark
Humanity's Last Exam
Frontier closed-ended academic benchmark across many subjects; often reported with and without tools.
Benchmark source →