benchmarks evals
The Olympiad Rubric Became the Benchmark
ScienceArena digitizes recent physics, chemistry and biology competitions with medalist-audited process-credit scoring.
Summary
ScienceArena digitizes recent physics, chemistry and biology competitions with medalist-audited process-credit scoring.
Fourteen models were evaluated on public multi-step exams. Top systems reached medal-equivalent rubric scores on several competitions, while chemistry, visual grounding and long-horizon consistency remained bottlenecks; two calibrated judges stayed within one point of expert totals in the reported audit.
Why it matters
ScienceArena digitizes recent physics, chemistry and biology competitions with medalist-audited process-credit scoring.
Limits and context
No additional limitation was separately recorded.
Key claims
ScienceArena digitizes recent physics, chemistry and biology competitions with medalist-audited process-credit scoring.
Evidence: source-2026-09-01-018
Sources
- arXiv preprint 2608.30517arXiv · primary research
Corrections
No corrections have been recorded for this story.