safety
The Agent Called Tools That Did Not Exist
A benchmark counted 322 tool hallucinations, then found 154 more on a live merged MCP surface.
Summary
A benchmark counted 322 tool hallucinations, then found 154 more on a live merged MCP surface.
A new benchmark separates fabricated tools, invalid schemas and other hallucinated calls from ordinary tool selection and authorization errors. Across ten hosted models and two invocation surfaces, the study measured 322 genuine hallucinations; fabricated-tool calls were far more common with unconstrained raw JSON than with a structured surface. A live Model Context Protocol test found 154 more hallucinations after multiple servers were merged, including collisions and shadowing that a single registry cannot represent. The proposed reference resolver checks membership and signatures before any causal gate, but borrowed arguments that fit a real schema remain irreducible.
Why it matters
A benchmark counted 322 tool hallucinations, then found 154 more on a live merged MCP surface.
Limits and context
- A live Model Context Protocol test found 154 more hallucinations after multiple servers were merged, including collisions and shadowing that a single registry cannot represent.
- The proposed reference resolver checks membership and signatures before any causal gate, but borrowed arguments that fit a real schema remain irreducible.
Key claims
A benchmark counted 322 tool hallucinations, then found 154 more on a live merged MCP surface.
Qualification: A live Model Context Protocol test found 154 more hallucinations after multiple servers were merged, including collisions and shadowing that a single registry cannot represent.
Evidence: source-2026-09-20-004
Sources
- arXiv preprint 2609.19425arXiv · primary research
Corrections
No corrections have been recorded for this story.