Description and configuration scanners are fast and worth running on every change. The 2026 preprint by Pei Chen and colleagues behind the scanner figure above measured eight static, dynamic and hybrid scanners at scale, and also found clear inconsistency across them. A long alert list does not tell a security lead which path an attacker would take, or whether your approval gates stop it.
A configuration review tells you what an agent could do; live testing shows what an attacker can make it do. A security review of an AI agent therefore has to answer the second question: given this agent, these tools, these permissions and this data, what can an attacker make it do? Our method follows the order an attacker would: map every tool, scope and data store each agent can reach; find where untrusted content enters; chain an attack through approval gates and permissions; show the effect; then turn the chain into a test. The methodology tracks MCP specification revision 2026-07-28, and servers on 2025-11-25 or earlier are also checked against that revision's session guidance.