Launch of Artificial Analysis Cyber Index for AI Cyber Defense Benchmarking

• •Artificial Analysis launched the Cyber Index to benchmark AI models in cyber defense.
• •The Cyber Index combines evaluations from three partners to assess vulnerability discovery and remediation.
• •Initial results show significant safety refusals from frontier models, impacting their scores.

On September 28, 2026, Artificial Analysis announced the launch of the Cyber Index and the Cyber Index Alliance, aimed at establishing a new standard for evaluating AI models in enterprise cyber defense tasks. The Cyber Index combines three evaluations—CWE-Bench-AA, DeepsecBench-AA, and CyberGym-E2E-AA—to assess how well AI models can discover and remediate vulnerabilities in codebases. The evaluations focus on defensive capabilities, with no tasks requiring models to create exploits. Major partners in the initiative include Collinear AI, IBM, NVIDIA, and Vercel. The Cyber Index aims to help organizations choose effective AI models for security work, especially as AI capabilities for both offense and defense evolve. The evaluations will provide insights into model performance, cost, and safety refusals, with a focus on real-world applicability. Initial results show that models like Grok 4.7 and MiMo-V2.6-Pro lead the scoring, while several frontier models declined a significant number of tasks due to safety concerns. The initiative is positioned as a response to the growing threat landscape where attackers increasingly leverage AI.