developer tools
Thirty-Two Tools Beat a List Four Times Longer
A state-path menu raised ToolBench online success from 0.737 to 0.898 by ordering prerequisite producers before the final action.
Summary
A state-path menu raised ToolBench online success from 0.737 to 0.898 by ordering prerequisite producers before the final action.
Tool retrieval usually ranks interfaces by their relevance to the user’s request, which can surface the final action while omitting the tools that create its inputs. State-Path Tool Menu instead predicts an executable route from the current state to the desired outcome, retrieves missing-input producers and then orders producers before consumers. On ToolBench, the authors report online success rising from 0.737 to 0.898. A 32-tool menu also covered more complete chains than the official 128-tool list, suggesting that executable order can outweigh raw menu size within the evaluated setup.
Why it matters
A state-path menu raised ToolBench online success from 0.737 to 0.898 by ordering prerequisite producers before the final action.
Limits and context
No additional limitation was separately recorded.
Key claims
A state-path menu raised ToolBench online success from 0.737 to 0.898 by ordering prerequisite producers before the final action.
Evidence: source-2026-09-10-004
Sources
- arXiv preprint 2609.09395arXiv · primary research
Corrections
No corrections have been recorded for this story.