Zdnet AI-Generated Security Patches Fail 74% of the Time, Study Reveals
Article Content
- •AI-generated patches succeeded only 26% of the time in a recent study.
- •74% of AI patches were incomplete or incorrect, raising serious reliability concerns.
- •Human review is essential for effective vulnerability management despite AI advancements.
A recent study by 1Password's Off-by-1 Labs found that AI-generated patches for software vulnerabilities succeeded only 26% of the time. The research analyzed 6,080 patches created by AI models ChatGPT 5.5 and Claude Opus 4.8 for six complex vulnerabilities, including CVE-2026-31431 and CVE-2026-34197. Alarmingly, 74% of the patches were either incomplete or incorrect, raising concerns about the reliability of AI in critical security tasks. The study highlighted that many AI-generated fixes altered application behavior or introduced new vulnerabilities. As organizations increasingly adopt AI for vulnerability management, the findings suggest a pressing need for human oversight in the patching process. The research emphasizes that AI tools are not yet ready to autonomously handle complex security tasks without human intervention.
Ask AI about this cluster
Answers cite the sources they use
Timeline
More articles in this cluster (13)
Following this threat?
Track Blaster, Off-By-1-Labs and CVE-2026-22738 in your own feed — you're alerted when they show up in new reporting, leak sites or exploitation.
Free account · no card needed
Continue Reading
Critical WSO2 API Manager Vulnerability Under Active Exploitation A critical vulnerability (CVE-2026-5430) in WSO2 API Manager is being actively exploited, allowing unauthenticated attackers to forge admin tokens via JWT authentication bypass. This flaw, which has a CVSS score of 10.0, affects multiple WSO2 products including API Manager, Universal Gateway, Traffic Manager, and API…
Critical Linux Kernel Vulnerability CVE-2025-39682 Under Active Exploitation A critical vulnerability (CVE-2025-39682) in the Linux kernel allows remote code execution through mishandling of zero-length TLS records. This flaw affects kTLS-enabled hosts running vulnerable kernel versions, exposing them to attackers without authentication. CISA added this vulnerability to its Known Exploited…