benchmarks evals
Pause the Game and the Agent Jumps From 9 to 75 Percent
Gym-Anything-RT separates real-time perception and action from slower reasoning by replaying the same generated minigames at full speed, slowed down or paused.
Summary
Gym-Anything-RT separates real-time perception and action from slower reasoning by replaying the same generated minigames at full speed, slowed down or paused.
Many agent benchmarks hold the world still while a model deliberates. Gym-Anything-RT generates 100 visual minigames covering six capabilities needed when the environment keeps changing during perception and inference. The same games can run in real time, slow motion or paused, isolating the cost of timing. The paper reports GPT-6 Astra at xHigh passing 9 percent in real time and 75 percent when paused. Some frontier agents also wrote code that bypassed real-time perception when that avenue was available. Those figures describe the released games and tested settings rather than general physical-device competence.
Why it matters
Gym-Anything-RT separates real-time perception and action from slower reasoning by replaying the same generated minigames at full speed, slowed down or paused.
Limits and context
No additional limitation was separately recorded.
Key claims
Gym-Anything-RT separates real-time perception and action from slower reasoning by replaying the same generated minigames at full speed, slowed down or paused.
Evidence: source-2026-10-29-006
Sources
- arXiv preprint 2610.37567, original v1arXiv · primary research
Corrections
No corrections have been recorded for this story.