safety
AI Risk Tools Covered the Technical Half
A map of 21 open tools found dense coverage of evaluation and guardrails but broad gaps in governance, law and finance.
Summary
A map of 21 open tools found dense coverage of evaluation and guardrails but broad gaps in governance, law and finance.
The study maps open-source evaluation and security tools against 32 subcategories in an extended AI-risk taxonomy using an LLM-assisted analysis of code and documentation, followed by three independent reviewers. The reviewers reached moderate agreement, and the final mapping achieved a reported 75.5 percent F1 after majority voting. Coverage clustered around technical and operational controls, leaving legal, governance and market risks sparse. The taxonomy is a planning aid, not a certification of any tool.
Why it matters
A map of 21 open tools found dense coverage of evaluation and guardrails but broad gaps in governance, law and finance.
Limits and context
- The taxonomy is a planning aid, not a certification of any tool.
Key claims
A map of 21 open tools found dense coverage of evaluation and guardrails but broad gaps in governance, law and finance.
Qualification: The taxonomy is a planning aid, not a certification of any tool.
Evidence: source-2026-08-10-011
Sources
- arXiv preprint 2608.07446arXiv · primary research
Corrections
No corrections have been recorded for this story.