benchmarks evals
Equal Answers Hid Different Mathematical Skills
A process benchmark decomposes agentic mathematics into planning, action and feedback capabilities.
Summary
A process benchmark decomposes agentic mathematics into planning, action and feedback capabilities.
Models with similar final-answer accuracy showed materially different capability profiles, supporting more diagnostic evaluation than one end score. The trajectories include controlled model rewriting, so the benchmark's fine-grained annotations remain part of what must be audited.
Why it matters
A process benchmark decomposes agentic mathematics into planning, action and feedback capabilities.
Limits and context
- The trajectories include controlled model rewriting, so the benchmark's fine-grained annotations remain part of what must be audited.
Key claims
A process benchmark decomposes agentic mathematics into planning, action and feedback capabilities.
Qualification: The trajectories include controlled model rewriting, so the benchmark's fine-grained annotations remain part of what must be audited.
Evidence: source-2026-08-28-017
Sources
- arXiv preprint 2608.26950arXiv · primary research
Corrections
No corrections have been recorded for this story.