Endorlabs Benchmarking Claude Fable 5 Reveals Harness Impact on Security Outcomes
Article Content
- •Cursor harness with Claude Fable 5 achieved 72.6% FuncPass and 29% SecPass.
- •Claude Code harness resulted in lower scores: 59.8% FuncPass and 19% SecPass.
- •The agent harness significantly influences security outcomes more than the model itself.
Endorlabs benchmarked the Claude Fable 5 AI model using two different harnesses, revealing significant differences in security outcomes. The Cursor harness achieved a 72.6% FuncPass and 29% SecPass, while the Claude Code harness resulted in a 59.8% FuncPass and 19% SecPass. The results indicate that the agent harness has a more substantial impact on security outcomes than the model itself. Despite the improvements, the security scores remain below 30%, indicating that many vulnerabilities are still left unaddressed. This benchmarking exercise involved 200 real-world vulnerability-fixing tasks in actual projects, highlighting the importance of the agent scaffolding in achieving better security results. The findings prompt further investigation into the relationship between model capabilities and harness effectiveness.
Ask AI about this cluster
Answers cite the sources they use
Timeline
More articles in this cluster (2)
Following this threat?
Track CVE-2017-12440 in your own feed — you're alerted when they show up in new reporting, leak sites or exploitation.
Free account · no card needed
Continue Reading
Path Traversal Vulnerability in Seafile SeaDoc Converter Seafile SeaDoc converter versions 2.0.4 to 2.0.10 and 3.0.0 to 3.0.7 are affected by CVE-2026-129167, an absolute path traversal vulnerability. This flaw allows unauthenticated attackers with a public token to execute arbitrary code by supplying an absolute filename to a specific API endpoint. Successful exploitation…
Vulnerability in OpenEMR Enables Remote Code Execution A vulnerability (CVE-2026-124450) has been identified in OpenEMR versions prior to 8.3.0, specifically within the fax/sms module. The flaw involves broken access control and path traversal through an unvalidated file_path parameter. This allows authenticated low-privilege users to read sensitive files, such as…