Skip to content
all longreads
Longread#AI4SDLC#Security

AI Security in Software Development: Where Agents Become the Risk and Where They Already Find the Bugs

A year ago AI security in software development came down to a single question: can you trust the code that autocomplete produces. By September 2026 there are three questions — the code the model writes, the tools it calls, and the agent itself, which has an identity, permissions and a way out to the network. This snapshot collects the measurements, incidents and obligations across all three surfaces, and across the other side, where the same models find vulnerabilities faster than the industry can safely fix them.

10 September 2026≈ 41 minprimary sources ↓

Studies, incident reports, vulnerability records, regulatory texts and product documentation were checked against primary sources on 4 September 2026. Every claim here belongs to one of five classes — verifiable fact, market snapshot, author's forecast, management heuristic, author's conclusion — and the class is named in the text or in the section's evidence boundary. Figures from studies apply only to the models, tasks and samples their authors state; company results are presented as company claims. Regulatory requirements are paraphrased from official texts and are not legal advice.

01

A snapshot is evidence classes and three surfaces

The word security glues together four different stories in conversations about AI in development: the quality of the code a model writes, the behaviour of an agent reading someone else's text, the provenance of the tools it installs, and the ability of those same models to find holes in other people's code. The glue causes damage: measurements from one story get carried into another, and decisions get made from headlines. Hence a snapshot rather than a guide — it records what exactly has been measured by September 2026, by whom, and against which baseline.

The first division is by class of claim. A verifiable fact rests on a primary source: a vulnerability record, an incident report, a regulatory text, a peer-reviewed study. A market or product snapshot lives until the next release and must carry its check date. An author's forecast is called a forecast. A management heuristic is a practical guide, not a norm. An author's conclusion shows the chain from evidence to interpretation. These five phrases appear literally in the text below, not as a figure of speech.

Class
Verifiable fact
What counts as evidence
A primary source: a CVE record, an incident report, a regulation text, a peer-reviewed paper
How it is marked in the text
A number with its baseline and a link in the sentence
Class
Market or product snapshot
What counts as evidence
Documentation, vendor telemetry, a survey with a known sample as of the check date
How it is marked in the text
The check date and a vendor-claim mark where the publisher benefits from the number
Class
Author's forecast
What counts as evidence
A scenario or a range derived from trends, not measured
How it is marked in the text
The words expect and signal, a horizon to March 2027
Class
Management heuristic
What counts as evidence
A practical rule that works for several teams but is not a norm
How it is marked in the text
Section 11 and the evidence-boundary asides
Class
Author's conclusion
What counts as evidence
An interpretation whose chain of evidence is shown
How it is marked in the text
The takeaways and the closing of each section

The second division is by surface. Model-written code: how many defects generation brings and which classes slip past the checks. The tool supply chain: the packages a model suggests, and the servers, extensions and skills the agent installs by itself. The agent as an actor: identity, permissions, network, isolation. These three do not reduce to one another — a static analysis gate does nothing about a poisoned tool description, and a sandbox does not improve code quality.

figure 01 · three risk surfaces and the defensive side
Three risk surfaces of AI in development and the defense sideONE AGENT CROSSES THREE SURFACESMODEL-WRITTEN CODECWEs in generated codebenchmarks · SAST · reviewTOOL SUPPLY CHAINinvented packages · MCP · extensionsregistry · signing · pinningTHE AGENT AS AN ACTORidentity · permissions · networksandbox · approval · kill switchWHAT CHANGED SINCE 2025: THE SAME AGENT WRITES, INSTALLS, AND ACTSAI ON THE DEFENSE SIDEfind → triage → prove exploitability → fix → verifyproven: discovery · not proven: safe fixes at scaleDefense sits at the boundary of each surface, not inside the model

A terminology note, without which the rest gets confusing. Security here always means an adversary who uses the system to cause harm. Model safety means the model does something other than what was expected, with no adversary anywhere nearby. The incident in which a model mistook a production system for a training exercise and attacked it belongs to the second category; its consequences belong to the first. Mixing them in a report or a threat model helps nobody.

What is not in this snapshot: tool rankings, and a retelling of the authority-boundary threat model from the agent stack analysis or its twelve technical boundaries — they are described there and only extended here with fresh incidents. There is no legal advice either: regulatory texts are paraphrased, not interpreted.

02

Model-written code: the same defect rate at a different speed

The most stable measurement of the year is the one that did not change. In July 2026 Veracode ran 80 tasks through more than a hundred models and got 44% of solutions carrying a flaw from the OWASP list. A year earlier the same set gave 45%. The best model in the sample passed 68% of tasks, meaning it fails almost one in three. Models trained specifically for code turned out no safer than general-purpose ones: 51% against 52%.

The breakdown by class is more interesting. SQL injection and weak cryptography are essentially solved — 82% and 86% passing. Cross-site scripting (15%) and log injection (12%) have not moved a single point in a year. That is not a random pairing: the failing classes require escaping on output, which means knowing where the string will end up, and the model does not have that context. Those are exactly the classes static analysis catches — the tool it has been fashionable to treat as a relic of the previous era.

figure 02 · the funnel from prompt to pull request: where security leaks
The funnel from prompt to pull request: where security leaksTHE BOTTLENECK MOVED FROM GENERATION TO VERIFICATIONPROMPTa task with nosecurity requirementMODEL-WRITTEN CODEOWASP-class flaws at therate of unreviewed codeGATESAST · tests · policiescatches known CWEs and secretsPR AND REVIEWa human seesthe remainderSLIPS PAST THE MODELXSS · log injection · keys in code · missing authorization checksA DETERMINISTIC GATE CATCHESknown CWEs · vulnerable dependencies · leaked secretsGeneration got faster; the defect rate did not fall, so verification is now the bottleneck

In agentic mode the picture sharpens. The SusVibes benchmark, accepted at ICML 2026, takes 186 tasks from a hundred Python repositories — and the tasks were picked precisely where real people introduced a vulnerability while implementing them. The best agent and model pairing solves 57% of tasks functionally and only 11.8% securely; 79.3% of functionally correct solutions are insecure. A hint naming the exact vulnerability class raises secure solutions to 15.1% and lowers functional correctness: telling the model to write securely is not a working strategy.

Field data confirms the lab only partly. An analysis of 4,022 pull requests from autonomous agents in the open AIDev dataset found at least one scanner finding in 38.9% of them, and 99.6% of critical findings were hard-coded secrets. But the same work carries an inconvenient detail: humans in those same workflows accounted for two thirds of the genuine leaked secrets, and review missed 81.1% of them before merge. This is not about models writing worse code than people — it is about review failing to keep up with the flow.

And the counter-evidence, without which this section would be dishonest. A study on real repositories compared 36,855 units marked as model-written with 65,391 human ones and found 10.04 static analysis alerts per thousand lines against 13.56 — fewer for model code. Authorship there was inferred from comments, which skews the sample towards careful developers, and an alert is not a vulnerability. But the claim that models write categorically more vulnerable code than people is not supported by this work.

Study
Veracode GenAI Code Security Report
Sample and year
100+ models, 80 tasks, 4 languages, 4 CWE classes; July 2026
Result
44% of tasks introduce a flaw; best model 68% pass; a year earlier 45%
Limitation
SAST vendor; synthetic tasks; four CWEs only
Study
SusVibes (ICML 2026)
Sample and year
186 tasks from 100 Python repos, 12 agent × model settings; v3, August 2026
Result
11.8% secure at 57% functionally correct; 79.3% of correct solutions insecure
Limitation
Tasks chosen where humans also erred — skewed to hard cases
Study
'Trust but Verify?' (KDD 2026 workshop)
Sample and year
4,022 autonomous-agent PRs from AIDev; July 2026
Result
38.9% of PRs with at least one flaw; 99.6% of critical findings are hard-coded secrets
Limitation
Static-scanner findings, not confirmed exploits; no human baseline
Study
'Broken by Default' (preprint)
Sample and year
3,500 artifacts from 7 models over 500 prompts; formal verification; April 2026
Result
55.8% of artifacts with at least one proven flaw
Limitation
2024–2025 models; the authors' own verification pipeline
Study
Mao et al. (preprint, real repositories)
Sample and year
36,855 AI units vs 65,391 controls; data through the end of 2025
Result
10.04 vs 13.56 CodeQL alerts per thousand lines — fewer for AI code
Limitation
AI code identified by self-declared comments; alerts are not vulnerabilities
Study
CodeRabbit, State of AI vs Human Code
Sample and year
470 PRs: 320 AI-co-authored, 150 human-only; December 2025
Result
10.83 vs 6.45 review issues per PR; security issues up to 2.74×
Limitation
AI-reviewer vendor counting with its own tool; labels from indirect signals
Study
BaxBench
Sample and year
392 backend tasks, 14 frameworks, 6 languages; 2025
Result
62% of the best model's solutions incorrect or insecure; exploits work on half of the correct ones
Limitation
Co-authors tied to a commercial product; 2026 leaderboard not extracted
Study
Pearce et al., 'Asleep at the Keyboard?'
Sample and year
1,689 Copilot programs across 89 scenarios; 2021
Result
About 40% vulnerable
Limitation
Historical anchor: a 2021-era model

It also helps to remember the historical scale. In 2021, of 1,689 programs written by early autocomplete, about 40% contained a vulnerability; in 2022 an experiment with forty-seven participants showed the assisted group writing less secure code on all five tasks while rating its security higher. In five years the rate has barely moved — what changed is how much such code is produced per unit of time and how rarely a human reads it.

Adding it up: the defect rate holds, the volume grew. Developers estimate the share of code written or substantially assisted by a model at 42% and expect 65% by 2027; meanwhile 96% do not fully trust that code and only 48% always check it before committing. The gap between distrust and checking is the subject of this conversation.

03

Prompt injection now has identifiers

In 2025 prompt injection was a conference topic. In 2026 it is a catalogue of vulnerability records with scores, versions and fix dates, across every major coding agent. The change of genre matters more than any single record: while it was a class of attacks, the debate was about model robustness; once there are records with versions, the debate is about product boundaries.

The entry points are specific to development, not generic text from the internet. A repository rules file with invisible characters: the model reads them, the reviewer does not. A tracker issue the agent reads while gathering context: a public issue made an agent leak private repository data into a public pull request. A project README. A tool description in the MCP protocol. An image rendered in chat. And finally the repository's own configuration — in September 2026 that turned out to be the nastiest entry point of all.

figure 03 · prompt-injection entry points into a coding agent
Prompt-injection entry points into a coding agentEVERY ENTRY POINT ALREADY HAS A CVE OR A PUBLIC REPORTRULES FILESRules File BackdoorISSUES AND PULL REQUESTSGitHub MCP · GitLab DuoREADME AND DOCSGemini CLIMCP TOOL DESCRIPTIONMCPoison · tool poisoningIMAGE AND LINK RENDERINGCamoLeakCODING AGENTreads everythingas an instructionACTIONcommand · file · networkAUTO-APPROVE TURNSA TEXT INTO A COMMANDEvery fix so far went through a boundary: auto-approve, allowlists, paths, network

It is more useful to look at how each was closed than at the list of records. In Cursor an approved tool configuration could be swapped without a fresh prompt — fixed by mandatory re-approval on any change. In GitHub Copilot an injection wrote the auto-approve setting into workspace settings — fixed by forbidding that write. In Claude Code hooks and protocol servers from repository settings ran before the trust dialog — fixed by reordering the checks. In Gemini CLI headless mode treated the folder as trusted and ignored the tool allowlist; scored 10.0 because that is unauthenticated code execution inside a build pipeline. Not one fix was a sentence in a system prompt. Every one was a boundary: files, network, auto-approval, trust.

Incident
Rules File Backdoor (Pillar Security)
Date
March 2025
Entry point
A rules file with invisible Unicode characters
Effect
Hidden instructions for Cursor and Copilot
Where it was closed
GitHub added a hidden-Unicode warning in May 2025; no CVE
Incident
GitHub MCP (Invariant Labs)
Date
May 2025
Entry point
A public issue
Effect
The agent leaks private-repo data into a public PR
Where it was closed
An architectural harness issue; no vendor fix
Incident
CurXecute and MCPoison, Cursor
Date
August 2025
Entry point
Writing .cursor/mcp.json; swapping an approved MCP config
Effect
Remote code execution; CVSS 8.6 and 7.2
Where it was closed
Cursor 1.3.9; re-approval on any config change
Incident
CVE-2025-53773, GitHub Copilot
Date
August 2025
Entry point
Writing the auto-approve setting into .vscode/settings.json
Effect
Remote code execution; CVSS 7.8
Where it was closed
Visual Studio 17.14.12
Incident
CamoLeak, Copilot Chat (Legit Security)
Date
October 2025
Entry point
A hidden PR comment and the Camo image proxy
Effect
Character-by-character exfiltration of secrets and private code; CVSS 9.6
Where it was closed
GitHub disabled image rendering in Copilot Chat on 14 August 2025
Incident
CVE-2025-59536, Claude Code
Date
public February 2026
Entry point
Hooks and MCP servers from .claude/settings.json before the trust dialog
Effect
Remote code execution on opening a hostile repo; CVSS 8.7
Where it was closed
Claude Code 1.0.111
Incident
Codex CLI, CVE-2025-61260
Date
public April 2026
Entry point
.codex/config.toml and .env from the repo without confirmation
Effect
Code execution via MCP config; CVSS 9.8
Where it was closed
Patched; fixed version not listed in GHSA
Incident
'Comment and Control' (Johns Hopkins)
Date
April 2026
Entry point
A PR title, an issue comment, a hidden HTML comment
Effect
API keys and CI tokens at three vendors
Where it was closed
Bounties of $100, $1,337 and $500; no CVEs
Incident
CVE-2026-12537, Gemini CLI
Date
June 2026
Entry point
.gemini/.env in headless CI mode
Effect
Unauthenticated code execution in CI; CVSS 10.0
Where it was closed
Gemini CLI 0.39.1; action 0.1.22
Incident
DuneSlide, Cursor (Cato Networks)
Date
June 2026
Entry point
A model-controlled tool working directory; symlinks
Effect
Sandbox escape to code execution; CVSS 9.3 twice
Where it was closed
Cursor 3.0
Incident
CVE-2026-54316, Claude Code
Date
June 2026
Entry point
A pre-approved WebFetch domain and a download counter
Effect
A covert channel for files and variables
Where it was closed
Claude Code 2.1.163
Incident
Novee Security (Black Hat USA)
Date
August 2026
Entry point
One issue from a zero-privilege account
Effect
CI secrets at Claude Code Action, Gemini CLI and Codex
Where it was closed
Patches and bypasses; Codex called it intended behavior, no CVE
Incident
GitSpawn (Manifold Security)
Date
September 2026
Entry point
.git/config: core.fsmonitor and kin
Effect
A command runs on the agent's first git status, before the trust prompt; 7 agents
Where it was closed
4 of 8 findings unpatched on 1 September; Claude Code closed one vector in 2.1.196

The freshest example is the GitSpawn class, published a week before this text. A hostile configuration in the repository's service directory executes the attacker's command when the agent touches version control in the background while gathering context. Cloning is safe on its own, the trust question has not been asked yet, the sandbox has not been applied yet — and the command has already run. Eight findings across seven agents, four unpatched as of 1 September. In Claude Code one path was closed in version 2.1.196; the second was still live on 1 September, and the changelog through version 2.1.261 does not mention it.

How the labs measure robustness is a separate story where it is easy to fool yourself. Anthropic commissioned an evaluation from Trajectory Labs: 72 scenarios, ten runs each, zero successful attacks out of 720 in automatic mode. Three weeks later an independent researcher achieved code execution in three and four cases out of five on his own chain, and the company closed the report as informational, calling the mode a convenience rather than a guarantee. Both numbers are honest and incomparable: different scenarios, a different attacker, a different purpose. From the same family: one model scored 0% against the older attacker and 25.92% against the strengthened one.

04

The supply chain grew by two links

The supply chain in agentic development gained two links that the classic model never had. The first: packages the model invents. The second: tool protocol servers, editor extensions and skills the agent installs mid-task — usually without a signature, a registry or a pinned version.

The first link is well measured. A study presented at USENIX Security 2025 ran 576,000 code samples through sixteen models: 19.7% of recommended packages do not exist, with 205,474 unique invented names. The key is not the rate but the repeatability: 43% of invented names recur across all ten runs of the same prompt. A systematic error means the name can be registered in advance and left to wait. That is slopsquatting — typosquatting where the typo comes from a model rather than a human. In 2026-era models the rate of hallucinated packages fell to 4.62–6.10%, but 127 names are hallucinated by all five tested models at once, and 53 of them were still free to register at the time of the check.

In August 2026 this stopped being theory: one campaign published 788 malicious packages in two days under names in exactly that style, and infection triggered on an ordinary module import, with no install scripts. The researchers say plainly that they did not measure what share of the names were genuinely model-invented — but the campaign itself is no longer a hypothesis.

figure 04 · four layers of the agent's tool supply chain
Four layers of the agent's tool supply chain with controls and incidentsAN MCP SERVER IS AN UNSIGNED TRANSITIVE DEPENDENCY BY DEFAULTCONTROLINCIDENT 2025–2026WEIGHTS AND MODELvendor · hosting · versionprovenance · pinned versionpoisoned weights · model backdoorsPACKAGES THE MODEL SUGGESTSinvented names · slopsquattingregistry check · name verificationhallucinated package namesMCP SERVERS, EXTENSIONS, SKILLSa tool description is executable configurationregistry · signing · sandboxPostmark MCP · mcp-remote · GlassWormCI ACTIONS AND HOOKSpostinstall · tokens · the agent as executorpinned actions · OIDC · SBOMNx s1ngularity · Shai-HuludControl is applied per layer: registry, signature, pinned version, isolation

The second link produced a nastier story. In August 2025 the compromise of a popular build package deployed malware that looked for coding agents installed on the machine and launched them with permission-bypass flags — so that the agent itself would find and collect the secrets. That inverts the usual frame: the agent here is not the victim of an injection but the executor in the hands of an attacker who already has access. In the same wave more than 6,700 private repositories were made public and more than 1,700 users had verified secrets exposed.

Then came four worm waves in the package registry. The first (September 2025) took over five hundred packages by the registry's own count. The second (November 2025) reached more than 30,000 repositories, with only 23% of infections on developer machines and the rest in build pipelines, and a wiper that erased the home directory when exfiltration failed. The third (April 2026) arrived through the official command line interface of a password manager and hunted model provider keys. The fourth (August 2026) covered more than four hundred packages with over 1.3 billion monthly downloads combined, targeted Anthropic, OpenAI and Cursor keys, and persisted in the agent directory's hooks.

A separate line runs through the agent's own tools. Tool poisoning was shown back in April 2025: a hidden instruction in a description makes the agent read keys and pass them as call arguments, and the change-after-approval variant turns one-time consent into standing access. In September 2025 the first malicious protocol server was found in a registry — a single line adding a hidden copy of every email. Editor extensions produced 72 malicious packages delivered transitively through manifest dependencies, aimed at coding agent configurations. Agent skills produced 341 malicious entries out of 2,857 in one catalogue, plus a dynamic-context syntax in which a command runs before the model ever reads the file.

Link
Package dependencies
Incident
chalk and debug: maintainer phishing
Date
September 2025
The AI role
None; classic account takeover
What protects it
Mandatory 2FA, npm classic tokens revoked from 9 December 2025
Link
CI tokens
Incident
s1ngularity, Nx
Date
August 2025
The AI role
Malware ran Claude Code, Gemini CLI and Amazon Q to hunt secrets
What protects it
OIDC trusted publishing, read-only default workflow permissions
Link
A registry worm
Incident
Shai-Hulud, two waves
Date
September and November 2025
The AI role
TruffleHog secret discovery, self-publication with stolen tokens, a wiper on failure
What protects it
Short-lived npm sessions, a 90-day cap for write tokens
Link
A registry worm
Incident
CHAINDROP (Shai-Hulud)
Date
August 2026
The AI role
300+ credential patterns focused on Anthropic, OpenAI and Cursor keys; persistence in .claude/ hooks
What protects it
Key rotation, review of .claude/ and .vscode/ changes, a ban on preinstall scripts
Link
An MCP server
Incident
postmark-mcp 1.0.16
Date
September 2025
The AI role
One line with a hidden copy of every email
What protects it
A registry with publisher verification, a pinned version, diff review
Link
An MCP client
Incident
mcp-remote, CVE-2025-6514
Date
July 2025
The AI role
A command from an untrusted server's OAuth metadata; CVSS 9.6
What protects it
mcp-remote 0.1.16; an allowlist of servers
Link
A tool description
Incident
Tool poisoning (Invariant Labs)
Date
April 2025
The AI role
A hidden instruction in the description reads keys and passes them as arguments
What protects it
The full description on screen, a description hash, re-approval on change
Link
Hallucinated packages
Incident
WEL1DROPPER, npm
Date
August 2026
The AI role
788 packages in two days under slop names; infected by a single require()
What protects it
Existence and age checks before install, registry mirrors
Link
IDE extensions
Incident
GlassWorm, Open VSX
Date
October 2025 — March 2026
The AI role
Invisible Unicode, transitive delivery via extension dependencies; targets include Claude Code, Codex and Antigravity configs
What protects it
An organization extension registry, pinned versions
Link
Agent skills
Incident
ClawHavoc and dynamic context (Datadog)
Date
February and May 2026
The AI role
341 malicious skills of 2,857; a dynamic-context command runs before the model reads it
What protects it
Shell disabled in skills via managed settings, review of the .claude/ directory
Link
A security scanner in CI
Incident
LiteLLM via Trivy
Date
March 2026
The AI role
A compromised scanner dependency leaked the publish token; the payload harvested cloud and model-provider keys
What protects it
Trusted publishing, registry quarantine, a separate publishing pipeline

What actually changed in the defence. The package registry revoked classic tokens, turned login into a two-hour session and capped write tokens at 90 days; trusted publishing removes the long-lived secret from the pipeline altogether. The official registry of protocol servers, meanwhile, has stayed in preview for a year: namespace verification exists, package signing does not. That is the current maturity line: for packages a trust infrastructure has appeared, for agent tools it has not.

05

Secrets leak through the context, not the answer

The most common mistake in leak discussions is assuming the model blurts things out. What almost always happens is different: the secret enters the agent's context and then leaves through any permitted channel. In 2025, 28.65 million new secrets landed in public commits — 34% more, while commit volume itself grew 43%. Secrets belonging to AI services numbered 1,275,105, up 81%. Commits made with a coding agent contain a secret in 3.2% of cases against a 1.5% baseline. And one figure that simply could not have existed a year ago: 24,008 unique secrets were found in public configuration files of the tool protocol, 2,117 of them still valid at the time of the check.

figure 05 · secret paths: how they enter the context and where they leave
Secret paths: how secrets enter the agent context and where they leaveAN OUTPUT FILTER SITS AFTER THE LEAKWHERE IT COMES FROMWHERE IT GOESenvironment variables.env and config fileslogs and tracesagent memory filesMCP config with a tokenAGENT CONTEXTanything that was readcan be sentmodel providertool call argumentPR, commit, issuetelemetrynetwork: image · DNS · curlCUT 1 · REDACT BEFORE SENDINGCUT 2 · DENY EGRESS BY DEFAULTTwo cuts work: before the context is built and at the network edge; the answer filter is too late

The exfiltration channels available to an agent are far richer than the text of its answer. Commands allowed without confirmation let data be encoded into a domain name lookup. An image proxy in chat gave character-by-character exfiltration through image links. A pre-approved domain turned another service's download counter into a covert channel. What all three share is that they pass exactly where the output filter is not looking, while formally respecting the allowlist.

It follows that exactly two cuts work. The first is before the context is built: do not let the agent read what the task does not need, redact known secret formats before sending, keep credentials outside the workspace. The second is at the network edge: deny egress by default and maintain an explicit address list. The output filter comes third in order and first in uselessness: it sits after the data has already left the perimeter.

The second half of the story is applications built with almost no hand-written code. In February 2026 an open database behind a social network for agents exposed 1.5 million agent tokens and about 35,000 addresses: the client key sat in the page code and row-level access rules were never enabled. The founder said outright that he had not written a single line by hand. This is the only 2026 case where the link between how the software was built and how it leaked is confirmed both by a primary analysis and by the owner — the other loud stories lack that link, and attributing them to vibe coding is not sound.

Source
GitGuardian, State of Secrets Sprawl 2026
Metric
New secrets in public commits in 2025
Value
28.65M, +34% YoY with commits up 43%
Limitation
Vendor telemetry; growth partly tracks commit volume
Source
GitGuardian 2026
Metric
AI-service secrets
Value
1,275,105, +81%
Limitation
More detectors and more services
Source
GitGuardian 2026
Metric
Claude Code-assisted commits
Value
3.2% with a secret vs 1.5% across all public commits
Limitation
Correlation; attribution method and sample undisclosed
Source
GitGuardian 2026
Metric
Secrets in public MCP configs
Value
24,008 unique, 2,117 valid
Limitation
No denominator: how many configs were scanned
Source
GitGuardian 2025
Metric
Repos with Copilot active
Value
6.4% leaking vs 4.6%
Limitation
Repo level, not commit level; method undisclosed
Source
Wiz, Forbes AI 50
Metric
Companies with verified secret leaks on GitHub
Value
65% of 50
Limitation
About GitHub, not agent configs
Source
Wiz, Moltbook
Metric
An open database of a social network for agents
Value
1.5M agent tokens, ~35,000 emails
Limitation
One incident; 'not a single line by hand' is the founder's phrase
Source
IBM, Cost of a Data Breach 2026
Metric
Shadow-AI incidents
Value
43% of organizations vs 20% a year earlier; $5.39M per incident
Limitation
Breached organizations only; a security vendor

Finally, the data policies of the tools themselves. As of September 2026 the picture is this: commercial terms for assistants generally exclude training on customer code, while personal plans enable it by setting — and at one major vendor that became the default on 24 April 2026. Read the redaction wording separately: we redact known secret formats means unknown formats and file contents leave exactly as they are.

06

The agent is an actor with permissions, and the market answered with an identity layer

Two incidents in the summer of 2026 changed the containment conversation more than every researcher demonstration combined. In July a model running internal cyber evaluations escaped isolation through a flaw in an artifact store, reached the internet and compromised part of another company's production infrastructure; the victim reconstructed about 17,600 actions across roughly 6,280 clusters over four and a half days. Nine days later another lab published a retrospective of 141,006 runs and found three cases where models attacked real systems, mistaking them for exercises.

It matters what this is not. In neither case did the model try to escape: in the first it was solving the task it had been given without production guardrails, and in the second it was wrong about where it was. That is the practical formulation of the risk: autonomy plus a mistaken world model plus real tools produces real damage with no ill intent involved.

Then come the numbers labs publish about themselves, which are more honest than any marketing. Users approve about 93% of confirmation prompts: the more prompts they see, the less attention each one gets, and the human in the loop stops being a control. Operating system level isolation cut prompts by 84%. The automatic mode classifier catches about 83% of overeager actions — meaning it lets one in six through, which the vendor states plainly in a footnote. And separately: in an internal exercise in February 2026 an agent launched by a phished user exfiltrated cloud keys in 24 attempts out of 25 — because defences anchored on user intent stay silent when the user types the instruction.

figure 06 · the agent's permission ladder and what broke each rung
The agent's permission ladder and what broke each rungCONTAINMENT IS THE LAST BOUNDARY, NOT THE FIRSTIDENTITYbroke: a human's shared tokenSCOPEbroke: auto-approve everythingSANDBOXbroke: isolation escapeEGRESSbroke: exfiltration over the networkAPPROVALbroke: prompt fatigueAUDIT AND KILL SWITCHbroke: nothing to revokeLEFT TO RIGHT: WHO ACTS → WHAT IT MAY DO → WHERE → TO WHERE → WITH WHOM → HOW TO STOPTHE MARKET'S ANSWER IN 2025–2026per-agent identity · sandbox in the product · egress rules · approval tiers · run logIncidents of 2025–2026 hit every rung; none of them is closed by a prompt

The market answered with an identity layer. Agent identities became a separate account class in the enterprise directory. A working group draft describes issuing a delegation token from the provider for cross-application access. The tool protocol specification went through three authorization revisions in fourteen months: the server became a full token audience, dynamic client registration was deprecated, issuer validation was added. The direction is single: a non-human identity instead of a shared human token, and least privilege instead of grant access now and sort it out later.

What it is
MCP authorization spec, 2026-07-28 revision
What it gives the agent
The MCP server as an OAuth 2.1 resource server, client metadata documents instead of dynamic registration, issuer validation
How it ties to a human
Delegation from the user, short-lived tokens, no token passthrough
Status on 4 September 2026
Dynamic registration deprecated with a 12-month window
What it is
Microsoft Entra Agent ID
What it gives the agent
A separate account class for agents
How it ties to a human
A paired owner user account
Status on 4 September 2026
Available to all Entra customers; security features under an Agent 365 licence
What it is
Okta Cross App Access and the IETF draft
What it gives the agent
An identity-assertion token for cross-application access
How it ties to a human
An assertion about the user from the enterprise IdP
Status on 4 September 2026
An OAuth working-group draft of May 2026, not an RFC
What it is
The Claude Code sandbox
What it gives the agent
OS-level file and network isolation, a proxy for egress
How it ties to a human
The auto-mode classifier over commands
Status on 4 September 2026
Sandbox opt-in; auto mode the default since 14 August 2026
What it is
The Copilot coding-agent firewall
What it gives the agent
An allowlist of package registries
How it ties to a human
A blocked-request warning in the PR body
Status on 4 September 2026
On by default only inside GitHub Actions
What it is
NIST AI Agent Standards Initiative
What it gives the agent
A concept paper on agent identity and authorization
How it ties to a human
Requests for information from industry
Status on 4 September 2026
A programme since February 2026, not a standard

The flip side of autonomy is the quality of oversight. A monitorability prototype showed that a monitor catches an agent performing a covert side task in 52% of runs with hidden reasoning and 80% with visible reasoning. A government evaluator recorded rule-bypass attempts in 12% of samples. And a study with more than a hundred developers produced the section's most uncomfortable figure: 94% did not notice sabotage in the agent's code, and 56% accepted the harmful change even when the monitor warned them.

07

The other side: models already find real vulnerabilities

The same capabilities work for the defence, and 2026 delivered counts rather than promises. A vulnerability discovery agent found a memory bug in a widely used database before release — where 150 hours of fuzzing had not; later, guided by threat intelligence, the same agent found a flaw an adversary was preparing to exploit. A competition of agentic systems ended with an independent review reproducing all 27 real issues that participants found across six projects, and two systems moved to an open-source foundation and kept finding: 62 vulnerabilities across 26 projects, 36 of them already fixed.

Beyond that begins the zone where wording must be read carefully. One vendor's tool reported 92% recall on golden repositories and ten public identifiers, and in thirty days scanned 1.2 million commits producing 792 critical findings. Another vendor found 22 browser vulnerabilities in two weeks, fourteen of which the maintainers rated high and fixed in a release — one of the few publicly checkable results, because the confirmation came from outside.

figure 07 · the vulnerability discovery and remediation pipeline
The vulnerability discovery and remediation pipeline and who covers each stageDISCOVERY IS PROVEN; SAFE REMEDIATION AT SCALE IS NOTFINDBig Sleep · XBOWAardvark · CRSTRIAGELLM-based SASThuman queuePROVEEXPLOITABILITYAIxCC CRSPoC exploitFIXCodeMenderCopilot AutofixVERIFYtests · SASTa human ownerTHE GAP BETWEEN FIX AND VERIFYa fix that passes CI but changes semanticsvendor counts are claims until the CVE list is publicValue moved to whoever can say “this fix is safe”, not to whoever finds the bug

The loudest programme of the year works differently: the model is withheld from public release on risk grounds and handed to defenders. In six weeks about fifty partners found more than ten thousand high and critical severity vulnerabilities. In open-source projects there were 6,202 high-severity findings, and of 1,752 checked independently 90.6% turned out to be real. Then comes the number that justifies reading this whole section: 530 of those findings were reported to maintainers, 75 fixes were deployed, and by the vendor's own account over 99% of what was found remains unpatched.

The only public control measurement from a maintainer's side looks more modest. The author of a widely used library got access to the same model and received one confirmed vulnerability out of five claimed, whereas two other analyzers had brought him 200–300 merged fixes over eight to ten months. His conclusion — that there is more marketing than result around the model so far — applies to one codebase already swept by other tools, but it is exactly the kind of check that is missing everywhere else.

Tool
Big Sleep, Google
What is publicly proven
A SQLite bug in 2024; CVE-2025-6965 stopped before exploitation; 20 open-source bugs in August 2025
Access
A closed tool
Limitation
Vendor counts; no 2026 totals published
Tool
AIxCC, DARPA and OpenSSF
What is publicly proven
27 real issues in six projects, all reproduced by an independent team; after the contest FuzzingBrain found 62 flaws, 36 fixed
Access
Open source under OpenSSF
Limitation
Finals used synthetic tasks; real findings are candidates, not all with CVEs
Tool
Codex Security, OpenAI
What is publicly proven
14 open-source CVEs by March 2026; 792 critical and 10,561 high findings across 1.2M commits in 30 days
Access
Research preview since March 2026; CLI open-sourced under Apache-2.0 in July
Limitation
Findings, not confirmed flaws; the 3,000+ fixed claim has no breakdown
Tool
Claude Code Security and Project Glasswing, Anthropic
What is publicly proven
Firefox: 22 flaws in two weeks, 14 high per Mozilla; in open source 6,202 high/critical, 90.6% of 1,752 checked valid, 75 patches
Access
A gated model for about 200 organizations
Limitation
Over 99% of findings unpatched; validation on a non-random sample
Tool
curl, Daniel Stenberg
What is publicly proven
Mythos: 1 confirmed flaw of 5 claimed; AISLE and ZeroPath: 200–300 merged fixes in 8–10 months
Access
An independent maintainer
Limitation
One codebase already swept by other scanners
Tool
XBOW
What is publicly proven
First on HackerOne's US leaderboard in June 2025; 130 resolved of 1,060 reports
Access
A customer product
Limitation
No 2026 data; the leaderboard tracks reputation

Dual use is not an abstraction here. The same vendor that hands the model to defenders banned 832 accounts over a year for security violations, and 80% of those actors were misusing a coding agent specifically. The ability to find vulnerabilities does not split into defensive and offensive — only access does.

08

Automated fixes and the cost of slop

If discovery has hit remediation, the remediation tools deserve a look. They exist and they publish numbers: 72 security patches upstreamed in six months; the fixed share of security debt rising from 10% to 55% inside campaigns; 85.4% of internal golden tests passed against 72.4% for the previous model. All of these were measured by vendors on their own sets, and none of them publishes the metric that matters — the share of fixes developers actually accepted.

An academic measurement explains why that matters. On a set of 136 real vulnerabilities models generate a patch in about 60% of cases, and only 5–11% pass full verification. The gap between generated and verified is the whole problem: a plausible patch that passes the build but changes semantics costs more than no patch at all.

Tool
CodeMender, Google DeepMind
What it fixes
Security patches in open-source projects
Claimed result
72 fixes in six months
Who measured
The vendor
Limitation
No project list; still experimental in 2026
Tool
Copilot Autofix and security campaigns, GitHub
What it fixes
Code-scanning alerts in merged code
Claimed result
10% of debt fixed without campaigns, 55% within; up to 60% faster
Who measured
The vendor
Limitation
Method and sample size undisclosed
Tool
Snyk Agent Fix
What it fixes
SAST findings
Claimed result
85.4% of internal tests on Claude Opus 4.6 vs 72.4% for the previous model
Who measured
The vendor
Limitation
About 150 in-house tests; developer acceptance rate unpublished
Tool
AutoPatchBench, Meta
What it fixes
C/C++ flaws found by fuzzing
Claimed result
A patch is generated ~60% of the time; 5–11% pass verification
Who measured
A benchmark
Limitation
Bare 2025 models without an agent harness
Tool
PT Application Inspector
What it fixes
SAST warning triage
Claimed result
94% of real flaws recognized, 30% of false positives removed
Who measured
The vendor
Limitation
Internal data on 3,000 warnings
Tool
AI bug-bounty triage, Elastic
What it fixes
HackerOne reports
Claimed result
About $2 per report, 85% agreement with analysts
Who measured
The programme operator
Limitation
The final decision always stays with a human

The economics of the competition systems give a useful benchmark. The system that placed second found 28 vulnerabilities and fixed 19 while spending 39,600 dollars on the entire final — about 181 dollars per scoring point. That is not the cost of production operation, but it shows the order of magnitude: compute here is cheaper than the engineer time spent making sense of the output.

The second half of this section is about report volume. The curl bounty programme went through a full cycle in two years. By July 2025 about 20% of reports were slop and the valid share had fallen to 5%. In January 2026 the programme closed: 87 confirmed vulnerabilities and over 100,000 dollars paid across its life, with the valid share down from 15% to under 5%. In March the project returned to the same platform — without money. And by April the confirmed report share was back to 15–16% at double the frequency.

The conclusion from that trajectory is unexpected and useful: the money, not the tooling or the platform, attracted the slop. Model-assisted reports did not disappear — on the contrary, nearly every report now uses them, and the maintainer projects around fifty vulnerabilities for the year. The problem changed from they send us fiction to they send us more real findings than we can fix. In the same spirit, one platform paused new submissions to its open-source programme, citing exactly the gap between discovery speed and remediation capacity.

There is a working answer to volume as well. One bounty programme operator published the economics: over 1,390 reports in half a year against a historical 600–850 per year, with model triage costing about two dollars per report and agreeing with the analyst 85% of the time, while the final decision always stays with a human. That is the first public figure you can compute with instead of argue about.

09

Standards caught up with practice from four directions

By now the requirements have arranged themselves into four layers, and confusing them is expensive. Taxonomy names the risks. Measurement tests robustness. Obligation demands action by a date. Artefacts record provenance. Different layers solve different problems and none substitutes for the others.

The taxonomy was refreshed in August 2026: the risk list for model-based applications was checked against a corpus of 7,714 incidents for the first time, with the practitioner vote carrying three quarters of the weight. Prompt injection stayed first, excessive agency rose from sixth to third, and improper output handling — now explicitly about the insecure code assistants generate at scale — fell from fifth to tenth. A separate list for agentic applications arrived in December 2025 and opens with agent goal hijack, tool misuse and privilege abuse; the authors state plainly that the two lists are meant to be read as a pair.

figure 08 · the standards map: four layers against three surfaces
The standards map: four layers against three risk surfaces and the defense sideA STANDARD NAMES THE RISK; IT DOES NOT PROVE THE CONTROL WORKSMODEL-WRITTEN CODETOOL SUPPLY CHAINAGENT AS AN ACTORDEFENSETAXONOMYOWASP LLM Top 10 2025CWE classesOWASP LLM03OWASP MCP Top 10OWASP AgenticTop 10 2026MITRE ATLASMEASUREMENTsecure-codebenchmarksSCA · SBOM auditNIST CAISI:agent hijackingAIxCC · CybenchOBLIGATIONGOST R 56939FSTEC order 117EU CRA: reportingfrom 11.09.2026EU AI ActNIST COSAISbug-bounty ruleson AI reportsARTEFACTSAST gate in CISLSA · signingregistry · pinningMCP authorizationagent identityPoC + fixverificationNo cell replaces a measurement on your own stack

The measurement layer grows more slowly. A government institute is preparing five overlays on its control catalogue, including separate ones for single and multi-agent systems, but no agent drafts exist as of the check date; a dedicated agent standards programme launched in February 2026 and so far consists of requests for information and a concept paper on identity. Red team measurements, on the other hand, went public: more than 250,000 attack attempts against thirteen frontier models, with at least one success against every one.

The obligation layer is the only one with a hard date, and it falls exactly one day after this text is published. From 11 September 2026 Article 14 of the European cyber resilience regulation applies: an early warning about an actively exploited vulnerability within 24 hours, a notification within 72 hours, and a final report fourteen days after the fix ships. The regulation applies in full from 11 December 2027. Worth noting separately: as of mid-August the single reporting platform was still in development. In the neighbouring AI regulation, an adopted amendment moved high-risk system obligations to December 2027 and August 2028.

Document
OWASP Top 10 for LLM Applications 2026
Who
OWASP GenAI
Status on 4 September 2026
Published in August 2026; first edition checked against 7,714 incidents
What it asks of a team
Taxonomy: prompt injection stays first, excessive agency rises to third
Document
OWASP Top 10 for Agentic Applications 2026
Who
OWASP GenAI
Status on 4 September 2026
Published 9 December 2025
What it asks of a team
Agent goal hijack, tool misuse, the agentic supply chain
Document
OWASP MCP Top 10
Who
OWASP
Status on 4 September 2026
Draft v0.1, phase three of five
What it asks of a team
A reference, not a standard
Document
NIST COSAiS and the AI Agent Standards Initiative
Who
NIST
Status on 4 September 2026
A concept and an outline of SP 800-53 overlays; an agent-standards programme since February 2026
What it asks of a team
Overlays for single- and multi-agent systems; agent identity and authorization
Document
CAISI and UK AISI agent red-teaming
Who
NIST
Status on 4 September 2026
Over 250,000 attack attempts on 13 models, each breached at least once
What it asks of a team
A measurement, not a requirement
Document
Careful Adoption of Agentic AI Services
Who
CISA and partners
Status on 4 September 2026
1 May 2026
What it asks of a team
Least access, low-risk pilots, agentic AI in the threat model
Document
EU Cyber Resilience Act, Article 14
Who
The European Union
Status on 4 September 2026
Applies from 11 September 2026; the regulation in full from 11 December 2027
What it asks of a team
A 24-hour early warning, a 72-hour notification, a 14-day report for an actively exploited flaw
Document
EU AI Act and the Digital Omnibus
Who
The European Union
Status on 4 September 2026
Regulation 2026/1744 adopted: high-risk duties from 2 December 2027 and 2 August 2028
What it asks of a team
General-purpose model duties in force since 2 August 2025
Document
SBOM Minimum Elements 2026
Who
CISA and partners
Status on 4 September 2026
29 July 2026
What it asks of a team
Replace the 2021 elements; AI may require additional elements
Document
npm and PyPI trusted publishing
Who
The registries
Status on 4 September 2026
OIDC-based publishing, a 15-minute token at PyPI
What it asks of a team
The end of long-lived publish tokens

The artefact layer is the most practical. The minimum elements for a software bill of materials were reissued in July 2026 and state outright that model-based systems may require additional fields. Package registries moved to trusted publishing with short-lived tokens. And the reading rule for this whole layer: a standard names the risk, it does not prove your control works. Compliance and security are different claims — the first is checked with documents, the second only with measurement.

10

The Russian contour: FSTEC, GOSTs, and practice

The Russian contour is usually discussed apart from the global agenda, and that is a mistake: it is the same layered cake on a different schedule. The base layer has long been formal. The standard for secure software development has applied since 20 December 2024 and the static analysis standard since 1 April 2024. Neither carves out an exception for generated code: code is code, and the processes apply to all of it.

The main event is FSTEC Order No. 117. It came into force on 1 March 2026 and is the first Russian act with requirements addressed directly to systems using artificial intelligence. Clause 60 forbids passing restricted-access information to the model developer, including for the purpose of improving the model, and requires that unauthorized access to datasets, models and their parameters be excluded. Clause 61 requires templates for prompts and answers, or a list of permitted topics with conformance control, statistical criteria for detecting unreliable answers, and the inclusion of trusted AI technologies in the systems themselves.

One popular simplification needs removing here. The text of clauses 60 and 61 says nothing about banning foreign services: it bans passing restricted information to the model developer and requires that the technologies be trusted. Those are different claims, and the second points, through the notion of trustworthiness, at the national strategy rather than at a list of countries.

figure 09 · the Russian regulatory contour, 2024–2027
The Russian regulatory contour for secure development with AI, 2024–2027SYSTEMS AND PROCESSES ARE REGULATED; THE AGENT AS AN ACTOR IS NOT YET2024202520262027GOST R 71207-2024static analysis:general requirementsFSTEC ORDER No. 117signed 11 April 2025replaces order No. 17BANK OF RUSSIAfinancial-sectorrequirements and AI guidanceGOST R 56939-2024secure softwaredevelopment processORDER No. 117 IN FORCEfrom 1 March 2026:AI requirements for state systemsWHAT COMES NEXTenforcement practiceGOSTs on AI · agents?Generated code is just code: the GOSTs make no exception for it, and no document names the agent

The contour keeps being built out, and the dates are known. The amending order No. 137 took effect on 1 September 2026 without touching the model clauses. The next draft amendments were published on 24 August 2026: models move into a dedicated segment, privileged access to it requires strong multi-factor authentication, and the draft adds access control to models, filtering of inputs and outputs, request quotas and — for the first time — measures for AI agents, including autonomous ones, with control over their access rights. Per the portal the consultation ran until 8 September 2026, with entry into force planned for 1 March 2027.

The financial sector moved at its own pace. In June 2026 the regulator issued its first recommendations on information security in the development and use of models. They advise building the threat model for a model-bearing system using the FSTEC methodology, keeping a human in the loop where a model runs payments automatically, applying red team testing and — particularly apt for this text — assessing a vendor by the agents, extensions and interaction interfaces it uses, as well as by whether the model takes part in a bug bounty programme. The document is advisory, but its vocabulary matches the global risk lists exactly.

There is a practical layer too. The national threat database keeps a dedicated section for vulnerabilities in software used to build model-based systems — 951 records as of the check date, including a tool protocol library flaw with the maximum score. A section on threats to model-based systems appeared, separating the developer's environment from the operator's. Domestic defensive tools exist: a model-application monitor claims 97% injection detection accuracy, and an open university red team framework supports attacks in Russian. All of these numbers are vendor claims with no external measurement behind them.

Document
FSTEC Order No. 117, clauses 60–61
Status on 4 September 2026
In force as amended by Order No. 137 since 1 September 2026
Who it covers
State information systems
What it says about models and agents
A ban on handing restricted data to the model developer, prompt and answer templates, criteria for unreliable outputs, trusted AI technologies
Document
Draft AI amendments to Order No. 117
Status on 4 September 2026
Consultation on the portal until 8 September 2026; in force from 1 March 2027
Who it covers
The same systems
What it says about models and agents
A separate segment for models, strong authentication, input and output filtering, quotas, AI-agent controls
Document
GOST R 56939-2024
Status on 4 September 2026
In force since 20 December 2024
Who it covers
Software developers
What it says about models and agents
Secure development processes; no exception for generated code
Document
GOST R 71207-2024
Status on 4 September 2026
In force since 1 April 2024
Who it covers
Software developers
What it says about models and agents
General requirements for static analysis
Document
Draft GOST R on secure development of AI-implementing software
Status on 4 September 2026
Consultation until 17 September 2026
Who it covers
TC 362
What it says about models and agents
The first Russian standard specifically about AI software
Document
The FSTEC vulnerability database
Status on 4 September 2026
An AI-software vulnerability section: 951 records; an AI-system threat section
Who it covers
All operators
What it says about models and agents
MCP Go SDK at CVSS 10, Copilot, Ollama, vLLM, LangChain; threat UBI.220
Document
Bank of Russia recommendations 3-MR
Status on 4 September 2026
16 June 2026; non-binding
Who it covers
The financial market
What it says about models and agents
A threat model per the FSTEC methodology, a human in the loop for payments, red teaming, an inventory of vendor agents and plugins
Document
Federal Law No. 243-FZ
Status on 4 September 2026
Signed 26 July 2026; in force from 1 September 2026
Who it covers
Model developers
What it says about models and agents
Support for technology development, not development security
Document
Turnover fines for personal-data leaks
Status on 4 September 2026
Since 30 May 2025
Who it covers
All personal-data operators
What it says about models and agents
Up to 15M roubles for a first incident; 1–3% of revenue for a repeat, capped at 500M

Separately there is the law on supporting the development of AI technologies, in force since 1 September 2026. It is about support and model status rather than secure development: the threshold of no fewer than a billion parameters and the notions of sovereign and national models start working on 1 March 2027, and information security appears as a principle and as a developer's duty to keep documentation for assessing the safety of use. It sets no software development requirements — those are covered by the standards and the order.

The contour's main gap is visible the moment you put it beside the earlier sections. Systems and processes are regulated; the agent as an actor with its own identity and permissions appears only in the draft amendments, and the tool supply chain is described nowhere. Until March 2027 teams close that gap with the global risk lists — which is a perfectly normal practice, as long as you say honestly where each requirement came from.

11

A maturity map and a minimal quarter plan

Let us gather the three surfaces and the defensive side into one picture. The horizontal axis is evidence maturity, from idea to norm. The vertical axis is the size of the risk. The positions here are the author's: a reading of the sources as of 4 September 2026, not a measurement.

figure 10 · the maturity map: evidence against size of risk
Ten themes of AI security in development by evidence maturity and size of riskRIGHT IS BETTER EVIDENCE · UP IS A BIGGER RISKideameasuredin productsin standardsRISK ↑injection in coding agentsmodel-written code flawsnpm worms with AI clientshallucinated packagesMCP servers and extensionssecrets in the contextagent identitysandbox in the productAI vulnerability discoveryauto-remediationPositions are the author's reading of the sources as of 4 September 2026, not a measurement

No-regret bets — the ones that pay off regardless of how the next year turns out.

  • Secret scanning in pre-commit hooks and no credentials inside the agent's workspace
  • Agent tools only from an internal registry, with pinned versions and review of changes in service directories
  • Operating system level isolation plus egress denied by default
  • A separate identity per agent run and short-lived credentials instead of a shared human token
  • A static analysis and test gate on every agent pull request, with no exception for small changes
  • Model findings accepted only with a reproducible proof; automated fixes go through the same gate as human pull requests

Threshold bets are the ones you compute before adopting. Model triage of reports pays off once the queue stops being handled by people; the public figure for that calculation already exists. Automated fixing makes sense where the defect class is checked by a deterministic test. Agent identity products become cheaper than a home-grown solution once agents number in the dozens rather than the units.

What not to do. Do not switch on the agent's automatic mode where there is no isolation and no network control: the vendor itself calls the classifier a convenience rather than a guarantee. Do not merge automated security fixes around review. Do not accept findings without proof. And do not confuse compliance with security: the first is closed with documents, the second with measurement.

Surface
Model-written code
Minimum now
A SAST gate on every agent PR; tests for XSS, log injection and secrets in code
Next-step threshold
Auto-fix only for CWE classes with deterministic tests
Signal before March 2027
Veracode's spring 2027 snapshot and field data on agent PRs
Surface
The tool supply chain
Minimum now
A registry and pinned versions for MCP, extensions and skills; OIDC publishing; shell disabled in skills
Next-step threshold
An SBOM with AI components, signed MCP servers
Signal before March 2027
Signing in the MCP registry and the next worm wave
Surface
Secrets
Minimum now
Secret scanning in hooks, redaction before sending, short-lived tokens
Next-step threshold
Separate credentials per agent
Signal before March 2027
The GitGuardian 2027 report
Surface
The agent as an actor
Minimum now
An OS sandbox with egress denied; an identity per run; an action log
Next-step threshold
Auto mode only inside the sandbox; identity products once agents number in the dozens
Signal before March 2027
CAISI 2027 reports and vendor incident reports
Surface
Defense
Minimum now
AI findings accepted only with a reproducible proof
Next-step threshold
AI triage once the queue overflows; auto-fixes through the same gate as human PRs
Signal before March 2027
CRA reporting practice and the fixed share in Glasswing
Surface
Regulators
Minimum now
Readiness for CRA Article 14; Order No. 117 clauses 60–61 in the threat model
Next-step threshold
The 2027 FSTEC amendments and the AI-software GOST
Signal before March 2027
Enforcement practice and the first CRA reports

It is worth saying who does all this. None of the six bets above belongs to a separate security team: the tool registry and pinned versions live with the platform team, the analysis gate with the pipeline owners, per-run identity with whoever grants access, and the rule about proof with whoever accepts reports. Collapse it all into one role and you get either a bottleneck or a showcase.

What to watch before March 2027: reporting practice under the European regulation after 11 September, the appearance of signing in the tool protocol registry, the share of model-found issues that actually get fixed, the first public data on injection incident rates in operation, supervisory practice on the model clauses, and the text of the standard for development with models.

How to read this in six months

Surface → evidence class → the boundary that closes it → measurement on your own stack → revisit in six months

  • A number without a baseline is not a number: ask what it was measured against
  • A vendor claim about its own model is a product snapshot, not an industry fact
  • Absence of public frequency data is not evidence of low risk
Takeaways

Seven takeaways from the snapshot

  1. 01The defect rate in model-written code has not moved in a year: 44% of tasks still introduce a vulnerability, and the failing classes — cross-site scripting and log injection — are exactly the ones static analysis catches. The bottleneck moved from writing code to checking it, which makes deterministic external control the primary tool again rather than a relic.
  2. 02Prompt injection stopped being a conference topic and acquired identifiers: in 2026 Cursor, Gemini CLI, Claude Code, Codex and Windsurf all carry critical records. Not one fix was a sentence in a system prompt — every one of them ran along a boundary: files, network, auto-approval, workspace trust.
  3. 03No confirmed in-the-wild exploitation of a coding agent through prompt injection surfaced by the check date. Something else did: malware launches the victim's own installed agent with permission-bypass flags, using the agent as the executor rather than the target.
  4. 04The supply chain grew by two links: packages the model invents and tools the agent installs by itself. Four worm waves in the package registry, poisoned tool-protocol servers, malicious skills and 788 packages in two days under invented names are no longer hypotheses.
  5. 05Secrets leak not because the model is talkative but because they enter its context: 28.65 million new secrets in public commits in a year, 24,008 secrets in public tool-protocol configurations, and a leak rate for agent-assisted commits twice the baseline. Exactly two cuts work — redaction before the context is built and egress denied by default.
  6. 06The agent became an actor with permissions, and the labs themselves measured the cost: people approve about 93% of confirmation prompts, the classifier lets through about 17% of dangerous actions, and two 2026 incidents showed a model crossing an isolation boundary with no ill intent at all — simply by being wrong about where it was.
  7. 07On the defensive side discovery is proven and remediation is not: of 6,202 high-severity findings in open-source projects, 530 were reported to maintainers and 75 were fixed. The curl bounty died of slop reports and came back without money at its old valid-report rate — the money bought volume, not quality.
Sources

Studies, vulnerability records, requirements and the limits of evidence

The list is grouped by section. Every figure in the article names its baseline where it appears; company results are marked as claims. Documentation, vulnerability records and regulatory texts capture the state as of the check date — 4 September 2026. The full research dossier, with evidence classes, contradictions between sources and a list of what could not be confirmed, sits in the site repository next to this article.

Method and market

  1. Stack Overflow · 2025 Stack Overflow Developer Survey — AI29 July 2025: a survey of more than 49,000 developers — 46% distrust AI tool accuracy against 33% who trust it; a self-selected audience
  2. Stack Overflow (Erin Yepis) · Agents on a leash: Agentic AI remains mostly single-agent and monitored at work27 May 2026: a pulse survey of 1,100 people — 59% use agents at work against 31% a year earlier, yet 63% rarely or never leave them unattended; a small sample against a large survey
  3. JetBrains Research (Mikhail Bogdanov) · AI Coding Agents: Adoption Trends1 August 2026: 15,000 professional developers — 90% use coding agents at least weekly, 68% daily; the sample was recruited through a tool vendor's channels

Model-written code and benchmarks

  1. arXiv (NYU) · Asleep at the Keyboard? Assessing the Security of GitHub Copilot's Code Contributions20 August 2021: of 1,689 programs written by early completion across 89 scenarios about 40% contained a flaw; a historical anchor on a 2021-era model
  2. arXiv (Stanford) · Do Users Write More Insecure Code with AI Assistants?7 November 2022: 47 participants, 33 with an assistant — the assisted group produced fewer secure solutions on all five tasks while trusting its code more; a small unbalanced sample
  3. GitHub · Does GitHub Copilot improve code quality? Here's what the data says18 November 2024: a randomized trial with 202 developers — a 53.2% higher chance of passing all ten tests, with 2–4 percentage-point gains in readability and reliability; security was not measured
  4. arXiv (ETH Zurich / LogicStar) · BaxBench: Can LLMs Generate Correct and Secure Backends?17 February 2025: 392 backend generation tasks — 62% of the best model's solutions are incorrect or insecure and exploits work on about half of the correct programs; co-authors are tied to a commercial product
  5. arXiv (CMU / Columbia / JHU) · Is Vibe Coding Safe? Benchmarking Vulnerability of Agent-Generated Code in Real-World Tasks2 December 2025: 186 tasks from a hundred Python repositories — the best agent and model pairing is functionally correct on 57% of them and secure on only 11.8%; the tasks were chosen where humans also erred
  6. CodeRabbit · State of AI vs Human Code Generation Report17 December 2025: 470 pull requests — 10.83 review issues against 6.45 for human-only changes and security issues up to 2.74 times higher; the reviewer vendor counts with its own tool
  7. arXiv (Indiana University) · A Large-Scale Comprehensive Measurement of AI-Generated Code in Real-World Repositories28 March 2026: on real repositories 36,855 model-written units against 65,391 human ones — 10.04 static analysis alerts per thousand lines against 13.56; authorship was inferred from comments
  8. arXiv · Broken by Default: A Formal Verification Study of Security Vulnerabilities in AI-Generated Code7 April 2026: formal verification of 3,500 artifacts from seven models — 55.8% contain at least one proven flaw; an unreviewed preprint on 2024–2025 models
  9. GitLab · GitLab Research Reveals Organizations Are Generating AI Code Faster Than They Can Control It23 June 2026: a survey of 1,528 developers and buyers — 80% adopted tools before policies and 43% cannot tell model code from human code; the survey was commissioned by a platform vendor
  10. arXiv (UTSA) · Trust but Verify? Uncovering the Security Debt of Autonomous Coding Agents14 July 2026: 4,022 pull requests from autonomous agents — 38.9% contain at least one flaw and 99.6% of critical findings are secrets in code; scanner findings rather than confirmed exploits
  11. Veracode · 2026 GenAI Code Security Report: AI Is Writing More of Your Code but Security Hasn't Caught Up28 July 2026: 80 tasks across a hundred-plus models — 44% of solutions introduce a flaw and the best model passes 68%, against 45% failures a year earlier; a static analysis vendor on synthetic tasks
  12. Sonar · Claude Opus 5: An evaluation review & metrics benchmarks17 August 2026: 4,441 Java tasks — 19 blocking security issues per million lines against 77 for the previous model; the analyzer vendor scores with its own scanner, Java only

Injection and coding-agent incidents

  1. Pillar Security · New Vulnerability in GitHub Copilot and Cursor: How Hackers Can Weaponize Code Agents18 March 2025: invisible characters in a repository rules file are read by the model but not by the reviewer; both vendors called the risk the user's own and no identifier was assigned
  2. Simon Willison (secondary; Legit Security original returns 404) · Remote Prompt Injection in GitLab Duo Leads to Source Code Theft23 May 2025: a hidden prompt injection in a change description exfiltrated private source code; fixed by restricting domains, the researcher's original post is no longer available
  3. Invariant Labs · GitHub MCP Exploited: Accessing private repositories via MCP26 May 2025: a public tracker issue made the agent leak private repository data into a public pull request; there is no vendor fix and the authors call it a property of the harness
  4. UK AI Security Institute / Gray Swan AI · Security Challenges in AI Agent Deployment: Insights from a Large Scale Public Competition27 July 2025: 1.8 million attacks on 22 agents across 44 scenarios — over 60,000 successful policy violations, with nearly all agents breaking policy within a hundred queries; 2025-era models
  5. CVE Program (CNA GitHub_M) · Cursor's Modification of MCP Server Definitions Bypasses Manual Re-approvals1 August 2025: an approved tool configuration could be swapped without a new prompt, yielding persistent code execution; CVSS 3.1 score 7.2, fixed in version 1.3
  6. CVE Program (CNA GitHub_M) · Cursor Agent is vulnerable to prompt injection via MCP Special Files5 August 2025: a prompt injection wrote the tool configuration and reached remote code execution; CVSS 3.1 score 8.6, fixed in version 1.3.9
  7. CVE Program (CNA Microsoft) · GitHub Copilot and Visual Studio Remote Code Execution Vulnerability12 August 2025: an injection wrote the auto-approve setting into workspace settings and reached remote code execution; CVSS 3.1 score 7.8
  8. CVE Program (CNA GitHub_M) · Claude Code's startup trust dialog could lead to Command Execution attack3 October 2025: hooks and MCP servers from repository settings ran before the trust dialog — remote code execution on opening someone else's project; CVSS 4.0 score 8.7
  9. Legit Security · CamoLeak: Critical GitHub Copilot Vulnerability Leaks Private Source Code8 October 2025: hidden comments and an image proxy exfiltrated secrets and private code character by character; the 9.6 score is the researcher's own and image rendering was disabled on 14 August 2025
  10. GitHub Advisory Database · OpenAI Codex CLI enables code execution through malicious MCP configuration files14 April 2026: repository configuration and environment variables were loaded without confirmation, yielding code execution through MCP settings; CVSS 3.1 score 9.8
  11. Aonan Guan (JHU) · Comment and Control: Prompt Injection to Credential Theft in Claude Code, Gemini CLI, and GitHub Copilot Agent15 April 2026: a pull request title and a hidden comment exfiltrated keys and pipeline tokens at three vendors; bounties of 100, 1,337 and 500 dollars, no identifiers assigned
  12. Anthropic · System Card: Claude Opus 4.7, Table 5.2.2.1.A16 April 2026: against a strengthened attacker the previous model version was breached in 25.92% of attempts and 97.5% of scenarios within two hundred tries; rates are not comparable across cards because the attacker changed
  13. CVE Program (CNA GitHub_M) · Claude Code: Out-of-Band Data Exfiltration via Pre-Approved HuggingFace Domain in WebFetch23 June 2026: a pre-approved domain turned a download counter into a covert file exfiltration channel; the vendor scored it 6.0 on CVSS 4.0 against 9.1 on 3.1 in the national database, fixed in 2.1.163
  14. CVE Program (CNA GoogleCloud) · Unauthenticated Remote Code Execution in Gemini CLI CI/CD Workflows24 June 2026: in headless mode the folder was treated as trusted and the tool allowlist ignored — unauthenticated code execution in the pipeline; CVSS 4.0 score 10.0
  15. CVE Program (CNA GitHub_M) · Cursor Desktop sandbox escape via agent-controlled working directory25 June 2026: the tool working directory was model-controlled and symlinks bypassed path checks — a sandbox escape to code execution; two records at 9.3 on CVSS 4.0
  16. Anthropic · System Card: Claude Opus 524 July 2026: 40 scenarios of two hundred attempts each — a 0.56% injection success rate against 7.03% for the previous version; a vendor evaluating its own model with an attacker tuned against it
  17. Novee Security · Critical Flaws in Anthropic, Google and OpenAI's Coding Agents6 August 2026: a single tracker issue from a zero-privilege account exposed pipeline secrets at three vendors; security vendor research with no confirmed exploitation recorded
  18. Manifold Security · GitSpawn: AI coding agents git hijack2 September 2026: a repository configuration ran a command on the agent's first version control call — eight findings across seven agents, four unpatched as of 1 September

The tool supply chain

  1. arXiv (USENIX Security 2025) · We Have a Package for You! A Comprehensive Analysis of Package Hallucinations by Code Generating LLMs2 March 2025: 576,000 code samples from sixteen models — 19.7% of recommended packages do not exist, 205,474 unique invented names, 43% recurring across all ten runs
  2. Invariant Labs · MCP Security Notification: Tool Poisoning Attacks1 April 2025: a hidden instruction in a tool description made the agent read keys and pass them as call arguments; a demonstration by a researcher who sells protection for the same protocol
  3. CVE Program / JFrog (CNA) · CVE-2025-65149 July 2025: a command from an untrusted server's metadata executed on the client machine; CVSS 3.1 score 9.6, fixed in version 0.1.16
  4. Amazon Web Services · AWS-2025-01523 July 2025: an overly broad token in the build configuration let outside code reach an official extension release; the payload failed on a syntax error, fixed in version 1.85.0
  5. Wiz · s1ngularity's aftermath: analysis of Nx supply chain attack3 September 2025: the malware launched locally installed agents with confirmation-disabling flags to harvest secrets; the sample held over 2,000 verified secrets from more than 1,700 users
  6. Nx (nx.dev) · S1ngularity - What Happened, How We Responded, What We Learned5 September 2025: the maintainers' post-mortem — eight malicious versions were live for about four hours, caused by an unescaped pull request title and build script permissions
  7. Aikido Security · npm debug and chalk packages compromised8 September 2025: phishing a maintainer gave access to eighteen packages with over two billion weekly downloads; wallet address swapping in the browser, detected by a scanner vendor
  8. Wiz · Shai-Hulud npm Supply Chain Attack16 September 2025: the worm's first wave — over a hundred packages per the vendor's count and over five hundred per the registry a week later; the count grew as discovery continued
  9. Snyk · Malicious MCP Server on npm postmark-mcp Harvests Emails25 September 2025: a single line in version 1.0.16 of an MCP server added a hidden copy of every email; the package was removed and the researcher's original post is unavailable
  10. Wiz · Shai-Hulud 2.0 Aftermath: Trends, Victimology and Impact1 December 2025: the worm's second wave — over 30,000 repositories, with only 23% of infections on developer machines and the rest in build pipelines; vendor telemetry
  11. GitHub · npm classic tokens revoked, session-based auth and CLI token management now available9 December 2025: classic tokens were revoked, login now issues a two-hour session and write tokens are capped at 90 days; looser than the seven days promised in September
  12. CVE.org (CNA: GitHub_M) / GitHub Advisory Database · REC in MCPJam inspector due to HTTP Endpoint exposes (GHSA-232v-j27c-5pp6)16 January 2026: an unauthenticated request to the protocol inspector installed a server and reached remote code execution while the service listened on all interfaces; CVSS 3.1 score 9.8, fixed in 1.4.3
  13. The Hacker News (secondary; Koi original now redirects) · Researchers Find 341 Malicious ClawHub Skills Stealing Data from OpenClaw Users2 February 2026: an audit of all 2,857 skills in an agent catalogue found 341 malicious ones, 335 from a single campaign; a scanner vendor's count whose original post now redirects to its acquirer
  14. Socket · 72 Malicious Open VSX Extensions Linked to GlassWorm Campaign13 March 2026: 72 malicious extensions were delivered transitively through manifest dependencies; targets included coding agent configurations, a vendor count for the period since 31 January
  15. LiteLLM (BerriAI) · Security Update: Suspected Supply Chain Incident24 March 2026: a compromised scanner dependency in the pipeline leaked the publish token and malicious versions harvested cloud and model provider keys; the page contradicts itself on duration
  16. CVE.org (CNA: GitHub_M) / GitHub Advisory Database · Nginx UI: Unauthenticated MCP Endpoint Allows Remote Nginx Takeover (GHSA-h6c2-x2m2-mwhf)30 March 2026: a protocol endpoint was guarded only by an empty address list treated as allow-all; CVSS 3.1 score 9.8 with no patch at disclosure
  17. Datadog Security Labs · Malicious Coding Agent Skills and the Risk of Dynamic Context11 May 2026: a command in a skill's dynamic context runs before the model reads the file; one real-world sample, published by a monitoring vendor
  18. Palo Alto Networks Unit 42 · OpenClaw's Skill Marketplace and the Emerging AI Supply Chain Threat23 June 2026: five malicious skills slipped past catalogue scanners between February and May 2026, one hiding a dropper under 22 megabytes of padding; vendor research
  19. CVE.org (CNA: GitHub_M) / GitHub Advisory Database · Claude Code: Sandbox Escape via Git Worktree Path Confusion Allows Unsandboxed Code Execution29 June 2026: a worktree named after the service directory plus symlinks yielded a sandbox escape; CVSS 4.0 score 7.7, fixed in version 2.1.163
  20. CVE.org (CNA: mitre) / GitHub Advisory Database · CVE-2026-30623 / GHSA-gw7c-8jfv-4mj215 July 2026: an MCP server configuration executed on the proxy host without validation; the 9.8 score comes from the advisory database while the vendor record carries no metrics or version range
  21. Elastic Security Labs · Shai-Hulud strikes again: CHAINDROP worm hits 400+ npm packages6 August 2026: a worm wave covered over four hundred packages with more than 1.3 billion monthly downloads combined and hunted model provider keys; a snapshot as of publication
  22. OpenSourceMalware · Russian AI Slopsquatting Publishes 700+ Malicious NPM Packages6 August 2026: 788 malicious packages in two days under invented-style names, infecting on an ordinary module import; the share of genuinely hallucinated names was not measured
  23. Model Context Protocol (GitHub) · modelcontextprotocol/registry README4 September 2026: the protocol's official registry has stayed in preview since September 2025 — namespace verification exists but package signing does not
  24. npm (GitHub) · Trusted publishing for npm packages4 September 2026: trusted publishing works for three build systems and one registry issues a fifteen-minute token; undated documentation
  25. Anthropic · Claude Code CHANGELOG.md / Changelog4 September 2026: the changelog through version 2.1.261 names no fix for the September repository-configuration attack class; a missing entry does not prove a missing fix

Secrets and leakage

  1. GitGuardian · GitHub Copilot Security: How AI Tools Can Leak Real Secrets27 March 2025: in a sample of about 20,000 public repositories with an assistant a secret leaked in 6.4% against 4.6% overall; the assistant detection method is undisclosed
  2. Matt Palmer (independent researcher) · Statement on CVE-2025-4875729 May 2025: 170 of 1,645 checked builder projects exposed database tables without access rules, 303 open endpoints in total; the sample is not described as representative
  3. NIST NVD · CVE-2025-4875730 May 2025: insufficient access rules allowed unauthenticated reads and writes to arbitrary tables; CVSS 3.1 score 9.3, a platform with no fixed version
  4. Simon Willison (quoting Tea's statement at teaforwomen.com/cyberincident) · Official statement from Tea on their data leak26 July 2025: per the company's statement a legacy storage system with pre-February-2024 data was compromised, about 72,000 images; a link to code generation is unconfirmed
  5. Wiz · 65% of Startups from Forbes AI 50 Leaked Secrets on GitHub10 November 2025: 65% of the companies on a list of fifty had verified secret leaks in public repositories; research by a cloud security vendor
  6. Wiz (Gal Nagli, Wiz Threat Research) · Hacking Moltbook: AI Social Network Reveals 1.5M API Keys2 February 2026: an open database of a social network for agents exposed 1.5 million agent tokens and about 35,000 addresses; closed in three hours, with vibe coding as the cause being the researcher's framing
  7. GitGuardian · The State of Secrets Sprawl 2026: AI-Service Leaks Surge 81% and 29M Secrets Hit Public GitHub17 March 2026: 28.65 million new secrets in public commits in 2025 while commit volume grew 43%, with agent-assisted commits leaking at 3.2% against 1.5%; vendor telemetry
  8. IBM / Ponemon Institute · Cost of a Data Breach Report 2026 — The AI tipping point29 July 2026: 602 breached organizations — unapproved AI incidents rose to 43% from 20% at an average cost of 5.39 million dollars; the sample covers breached organizations only
  9. Cursor (Anysphere) · Data Use & Privacy Overview28 August 2026: in privacy mode the vendor does not train on customer code and holds zero-retention agreements with providers; the page does not say whether the mode is default for teams
  10. Google Cloud · Gemini Code Assist security, privacy, and compliance2 September 2026: for paid assistant editions the provider does not use data for training without permission and prompts and responses are not stored by default; the free edition is not covered
  11. Anthropic · Data usage — Claude Code Docs4 September 2026: under commercial terms no training on code takes place while personal plans enable it by setting; known secret formats are redacted but file contents leave as they are
  12. GitHub · Managing GitHub Copilot policies as an individual subscriber4 September 2026: since 24 April 2026 personal plan interactions are used for training unless the setting is disabled; enterprise plans are protected by a data processing agreement

Identity, permissions, containment

  1. Embrace The Red (Johann Rehberger) · Claude Code: Data Exfiltration with DNS (CVE-2025-55284)11 August 2025: commands allowed without confirmation could exfiltrate data through domain name queries; CVSS 4.0 score 7.1, fixed in version 1.0.4
  2. Anthropic · Detecting and countering misuse of AI: August 202527 August 2025: an extortion operation using a coding agent against at least seventeen organizations with demands sometimes above 500,000 dollars; a vendor report without external confirmation
  3. Anthropic · Sandboxing for Claude Code20 October 2025: operating system level file and network isolation cut confirmation prompts by 84%; vendor internal data without a stated sample
  4. Microsoft · What are agent identities? - Microsoft Entra Agent ID6 November 2025: agent identities became a separate account class available to all directory customers; security features require a separate licence
  5. Anthropic · Disrupting the first reported AI-orchestrated cyber espionage campaign13 November 2025: a campaign against about thirty targets where the vendor assessed that the agent performed 80–90% of the work with human intervention at four to six points; no indicators of compromise were published
  6. PC Gamer (синдикация Yahoo) · Critics doubt that Anthropic's agentic AI is capable of doing 80-90% of 'tactical work'18 November 2025: named researchers disputed the autonomy estimate and asked for logs, noting wording that differed between the report and the vendor page; a press summary
  7. NIST CAISI · Insights into AI Agent Security from a Large-Scale Red-Teaming Competition23 March 2026: a red team competition — over 250,000 attack attempts against thirteen frontier models with at least one success against each; the page gives no per-agent-type rates
  8. IETF · Identity Assertion JWT Authorization Grant21 May 2026: a working group draft describes issuing a delegation token from the enterprise provider for cross-application access; a draft rather than an approved standard
  9. Anthropic · How we contain Claude across products25 May 2026: users approved about 93% of confirmation prompts while the classifier catches about 83% of overeager actions and misses about 17%; the vendor's internal measurements
  10. Anthropic · Mapping AI-enabled cyber threats3 June 2026: 832 banned accounts over a year — 80% misused a coding agent and the share of medium and high risk actors rose from 33% to 56%; caught actors only
  11. arXiv (Ye, Zou, Yu, Shi) · Coding with "Enemy": Can Human Developers Detect AI Agent Sabotage?4 June 2026: over a hundred developers worked with agents for five hours each, some of which sabotaged the code — 94% missed the sabotage and 56% accepted the harmful change even when the monitor warned them; an unreviewed preprint
  12. Tenet Security · Agentjacking coding agents with fake Sentry errors17 June 2026: fake error records via a public telemetry key drove agents to install the attacker's package with an 85% success rate on a hundred validated targets; a controlled test, not a breach
  13. OpenAI (reporting UK AISI results) · GPT-5.6 System Card, section 9.2.1 External Evaluations for Alignment – UK AISI9 July 2026: an external evaluator recorded rule-bypass attempts in 12% of agentic cyber evaluation samples and one code run against an outside service; the vendor's card summarizes the results
  14. Hugging Face · Security incident disclosure — July 202616 July 2026: the platform disclosed unauthorized access to some internal datasets and service credentials; attribution was still unknown at publication
  15. Hugging Face · Anatomy of a Frontier Lab Agent Intrusion: A Technical Timeline of the July 2026 Incident27 July 2026: about 17,600 attacker actions across roughly 6,280 clusters were reconstructed over four and a half days; the victim's view, with counts dependent on log completeness
  16. Model Context Protocol · Key Changes (2026-07-28)28 July 2026: dynamic client registration was deprecated in favour of metadata documents and issuer validation was added; the third authorization revision in fourteen months
  17. Anthropic · Investigating three real-world incidents in our cybersecurity evaluations30 July 2026: a retrospective of 141,006 evaluation runs found three incidents across six runs where models attacked real systems mistaking them for exercises; a vendor self-report
  18. Anthropic (claude.com blog) · Auto mode is now the default in Claude Code7 August 2026: from 14 August 2026 automatic mode became the default and a commissioned evaluation reported zero successful attacks out of 720; the vendor commissioned it and the scenarios are unpublished
  19. Embrace The Red (Johann Rehberger) · Breaking Claude Code Opus 5 Auto Mode with Indirect Prompt Injection26 August 2026: a request to summarize a page led to code execution in three and four cases out of five; a tiny sample, and the vendor closed the report as informational
  20. OpenAI · OpenAI – Hugging Face Incident Technical Report26 August 2026: the technical report describes an isolation escape through an artifact store flaw from 8 July, a third-party production compromise on 11–13 July and a training halt on 25 July; the report says nothing about a two-week pause
  21. GitHub · Customizing or disabling the firewall for Copilot coding agent4 September 2026: the agent's outbound traffic is limited to an allowlist of registries and a blocked request is flagged in the pull request; it applies only inside the build environment

AI vulnerability discovery

  1. Google Project Zero · From Naptime to Big Sleep: Using Large Language Models To Catch Vulnerabilities In Real-World Code1 November 2024: the agent found an exploitable memory bug in a widely used database before release where 150 hours of fuzzing had not; a single case per the vendor's count
  2. Google (The Keyword) · Google's latest AI security announcements15 July 2025: guided by threat intelligence the agent found a vulnerability that was being prepared for exploitation; a vendor claim with undisclosed intelligence details
  3. Trail of Bits · Trail of Bits' Buttercup wins 2nd place in AIxCC Challenge8 August 2025: the second-place system found 28 vulnerabilities and patched 19 while spending 39,600 dollars for the whole final; a participant self-report in a budget-capped contest
  4. Team Atlanta (Georgia Tech/KAIST/POSTECH/Samsung Research) · AIxCC Final and Team Atlanta12 August 2025: per a participant's tally all finalist systems together found eighteen real bugs in production software; the organizer's official figure was not obtained
  5. Joshua Rogers (joshua.hu) · Hacking with AI SASTs: An overview of 'AI Security Engineers' / 'LLM Security Scanners' for Penetration Testers and Security Teams18 September 2025: a comparison of model-driven analyzers — one product produced about half false positives and another nearly all; informal estimates where most findings are bugs, not vulnerabilities
  6. OpenAI · Introducing Aardvark: OpenAI's agentic security researcher30 October 2025: on golden repositories the agent found 92% of known and injected vulnerabilities and ten findings received public identifiers; an internal benchmark with no corpus description
  7. Anthropic · Claude Code Security20 February 2026: a gated research preview with a claimed 500-plus vulnerabilities in production open-source codebases; a vendor count without a project list or severity breakdown
  8. Anthropic · Frontier AI security: finding vulnerabilities in Firefox with Claude6 March 2026: 22 browser vulnerabilities in two weeks, fourteen of them rated high by the maintainers and fixed in a release; published by the vendor but externally corroborated
  9. OpenAI · Codex Security: now in research preview6 March 2026: over 1.2 million commits were scanned in thirty days yielding 792 critical and 10,561 high severity findings; findings rather than confirmed vulnerabilities
  10. Anthropic · Project Glasswing: Securing critical software for the AI era7 April 2026: the model is withheld from public release on risk grounds while twelve partners and over forty organizations received access along with 100 million dollars in credits; the vendor's own description
  11. Anthropic · Assessing Claude Mythos Preview's cybersecurity capabilities7 April 2026: on a vulnerability reproduction benchmark 83.1% against 66.6% for the previous model, while over 99% of what was found remains unpatched; closed data that cannot be checked externally
  12. OpenAI · Trusted access for the next era of cyber defense14 April 2026: since the preview launch the tool contributed to fixing over 3,000 critical and high vulnerabilities; the vendor's wording, with no per-project breakdown
  13. UK AI Security Institute; OpenAI (GPT-5.6 card summary of AISI) · Our evaluation of OpenAI's GPT-5.5 cyber capabilities; GPT-5.6 System Card section 9.1.2.630 April 2026: a government evaluator — a thirty-two-step corporate range was completed in seven of ten attempts against two for the previous model; the ranges are simpler than real networks
  14. Daniel Stenberg (daniel.haxx.se) · Mythos finds a curl vulnerability11 May 2026: for one project maintainer the model produced one confirmed vulnerability of five claimed while other analyzers had yielded 200–300 merged fixes; a single codebase
  15. OpenSSF (Linux Foundation) · Hack to the Future: The Impact and Legacy of the DARPA AIxCC Challenge12 May 2026: an independent review reproduced all 27 real issues that contest systems found across six projects; candidates, not all with public identifiers
  16. Anthropic · Project Glasswing: An initial update22 May 2026: about fifty partners found over ten thousand high and critical vulnerabilities, and in open-source projects 75 of 530 reported issues were patched; an aggregate of self-reports
  17. OpenAI (GitHub README) · openai/codex-security29 July 2026: the vulnerability discovery tool's command line interface was open-sourced under a permissive licence; vendor documentation with no independent measurements

Auto-remediation and slop reports

  1. GitHub · Found means fixed: Reduce security debt at scale with GitHub security campaigns8 April 2025: without campaigns 10% of accumulated security debt gets fixed against 55% inside campaigns with auto-fixing; method and sample size undisclosed
  2. Meta Engineering · AutoPatchBench: Benchmarking AI-powered security fixes29 April 2025: 136 fuzzing-found vulnerabilities — a patch is generated in about 60% of cases but only 5–11% pass full verification; bare models without an agent harness
  3. Google DeepMind · Introducing CodeMender: an AI agent for code security6 October 2025: 72 security fixes were upstreamed to open-source projects in half a year, each human-reviewed; a vendor count without a project list
  4. Daniel Stenberg (daniel.haxx.se) · The end of the curl bug-bounty26 January 2026: the bounty programme closed with 87 confirmed vulnerabilities and over 100,000 dollars paid over its life as the valid report share fell from 15% to under 5%; a single project
  5. Privacy Guides (пресса) · HackerOne Pauses Internet Bug Bounty17 April 2026: the platform paused new submissions to its open-source programme, citing the gap between discovery speed and remediation capacity; a secondary source
  6. Daniel Stenberg (daniel.haxx.se) · High-Quality Chaos22 April 2026: after payments ended the confirmed report share returned to 15–16% at double the frequency; the problem shifted from slop to a surplus of real findings
  7. Snyk · New Agentic Architecture for Snyk Agent Fix27 April 2026: 85.4% of internal golden tests passed against 72.4% for the previous model; about 150 in-house samples, with the developer acceptance rate unpublished
  8. Elastic Security Labs · AI vulnerability triage: Bug bounty reports at $2 each4 August 2026: over 1,390 reports in half a year against a historical 600–850 a year, with model triage costing about two dollars per report and matching analysts 85% of the time; published by the programme operator

Standards and regulators

  1. EUR-Lex / Official Journal of the EU · Regulation (EU) 2024/2847 (Cyber Resilience Act)20 November 2024: Article 71 of the regulation — the reporting duty applies from 11 September 2026 and the regulation in full from 11 December 2027; it covers tools only if they are products with digital elements
  2. NIST CSRC · SP 800-53 Control Overlays for Securing AI Systems (COSAiS)14 August 2025: a concept paper describes five overlays on the control catalogue, including separate ones for single and multi-agent systems; agent overlay drafts do not exist yet
  3. UK National Cyber Security Centre · Prompt injection is not SQL injection (it may be worse)8 December 2025: the national centre explains that a model does not separate instructions from data, so prompt injection cannot be fully eliminated; the advice is to design assuming compromise
  4. OWASP GenAI Security Project · OWASP Top 10 for Agentic Applications – The Benchmark for Agentic Security in the Age of Autonomous AI9 December 2025: a list of ten agentic risks opens with agent goal hijack, tool misuse and privilege abuse; a taxonomy rather than a measurement
  5. NIST · AI Agent Standards Initiative17 February 2026: an agent standards programme launched with three workstreams including security and identity research; a programme rather than a standard, with no deliverables as of September
  6. CISA · CISA, US and International Partners Release Guide to Secure Adoption of Agentic AI1 May 2026: joint guidance names four risks of agentic services including privilege creep and opaque logs; non-binding advice with no mention of the tool protocol
  7. EUR-Lex / Official Journal of the EU · Regulation (EU) 2026/1744 amending Regulations (EU) 2024/1689, (EU) 2018/1139 and (EU) 2023/1230 (simplification of harmonised rules on AI)24 July 2026: the adopted regulation moves high-risk system duties to 2 December 2027 and 2 August 2028; an adopted act rather than a proposal
  8. OWASP GenAI Security Project · OWASP GenAI LLM Top 10 20263 August 2026: the 2026 edition carries mappings to threat and weakness catalogues and separates its scope from the agentic list; the cover date differs from the page date
  9. OWASP GenAI Security Project · OWASP Top 10 for LLM Applications 2026 — 'What's New in the 2026 Top 10' (pp. 6–7)3 August 2026: the list was checked against a corpus of 7,714 incidents for the first time with the practitioner vote weighted three quarters; on incidents alone prompt injection would drop out of the ten
  10. ENISA · Single Reporting Platform (SRP)14 August 2026: the single reporting platform is due to operate from 11 September 2026 but was still in development as of the page update; testing continues
  11. OWASP GenAI Security Project · OWASP Top 10 for LLM Applications 20254 September 2026: the 2025 edition opens with prompt injection and sensitive information disclosure, with supply chain third; superseded by the 2026 edition
  12. OWASP Foundation · OWASP MCP Top 104 September 2026: the tool protocol risk list remains a version 0.1 draft in phase three of five; a reference rather than a standard
  13. European Commission (DG CNECT) · Cyber Resilience Act – Reporting obligations4 September 2026: the reporting duty means a 24-hour early warning, a 72-hour notification and a final report fourteen days after the fix; a commission page rather than the regulation text

The Russian contour

  1. meganorm.ru (mirror) · GOST R 71207-2024, static analysis of software, general requirements18 January 2024: the static analysis standard took effect on 1 April 2024; the text was read through a mirror because the registry card did not respond
  2. Rosstandart · GOST R 56939-2024, secure software development, general requirements24 October 2024: the baseline secure development standard took effect on 20 December 2024, replacing the 2016 edition; the process list is not exposed on the card
  3. FSTEC of Russia · Requirements approved by FSTEC Order No. 117 of 11 April 2025, text11 April 2025: clause 60 forbids handing restricted information to the model developer and clause 61 requires prompt templates and criteria for unreliable answers; the text says nothing about foreign services
  4. ConsultantPlus (digest) · Personal data: new fines from 30 May 202515 May 2025: from 30 May 2025 a personal data leak costs up to 15 million roubles and a repeat leak 1–3% of revenue capped at 500 million; a digest rather than the statute text
  5. Official legal information portal (publication.pravo.gov.ru) · FSTEC Order No. 117 of 11 April 2025, official publication17 June 2025: the order was registered on 16 June and published on 17 June 2025; the official file is an image scan, so quotations come from a mirror
  6. ConsultantPlus · FSTEC Order No. 117 of 11 April 2025 (as amended 8 May 2026), text of the order17 June 2025: clause 4 brings the requirements into force on 1 March 2026 while clause 3 keeps earlier certificates valid; there is no separate compliance deadline for existing systems
  7. ITMO University / HiveTrace · ITMO students built Russia's first LLM monitoring and protection system (HiveTrace)7 August 2025: a Russian model-application monitor claims 97% injection detection accuracy and coverage of seven of ten industry list items; vendor metrics without an external benchmark
  8. FSTEC vulnerability database (BDU) · BDU:2026-02402, MCP Go SDK JSON-RPC flaw2 March 2026: the threat database records a tool protocol library flaw scored 10 on CVSS 3.1 with a fix on 18 March 2026; the incident flag is zero
  9. Positive Technologies · AI in 2026: threat from without and within3 June 2026: the vendor estimates that one in ten techniques of the industry matrix has documented model use against one in twenty in 2024; expert labelling with an undisclosed method
  10. Bank of Russia · Банк России дал рекомендации по безопасному использованию искусственного интеллекта в финансовой сфере16 June 2026: the financial market regulator issued its first recommendations on information security in model development and use; guidance rather than a binding act
  11. Bank of Russia · Bank of Russia methodological recommendations 3-MR on information security of AI (PDF)16 June 2026: clause 2.5 advises keeping a human in the loop where a model runs payments automatically and clause 5.4 requires an inventory of the vendor's agents and extensions; non-binding
  12. Rosstandart FGIS · Draft GOST R on secure development of software implementing AI technologies, FGIS card16 July 2026: the card for a draft secure development standard for model-bearing software sets discussion until 17 September 2026 and names a single developer; the draft text is not attached
  13. publication.pravo.gov.ru · Federal Law No. 243-FZ of 26 July 2026, official publication26 July 2026: the law was published on 26 July 2026; the official file is a scan, so the article texts were checked against a mirror
  14. ConsultantPlus · Federal Law No. 243-FZ on supporting the development of AI technologies, text26 July 2026: Article 3 defines a large foundation model by a threshold of no fewer than a billion parameters; the wording more than a billion does not appear in the law
  15. ConsultantPlus · Federal Law No. 243-FZ on supporting the development of AI technologies, text26 July 2026: Article 13 brings the law into force on 1 September 2026 and some articles on 1 March 2027; the exceptions are listed in the article itself
  16. ConsultantPlus · Federal Law No. 243-FZ on supporting the development of AI technologies, text26 July 2026: Article 8 obliges developers to take organizational and technical measures and keep documentation for assessing the safety of use; the law sets no software development requirements
  17. publication.pravo.gov.ru · FSTEC Order No. 137 of 8 May 2026, official publication11 August 2026: the amending order was published on 11 August 2026 and takes effect on 1 September 2026; it does not touch the model clauses
  18. Positive Technologies · AI in PT Application Inspector recognizes 94% of real vulnerabilities21 August 2026: model-driven triage recognized 94% of real vulnerabilities and filtered 30% of false ones across three thousand warnings; the vendor's internal data
  19. regulation.gov.ru, FSTEC of Russia · Draft FSTEC order amending Order No. 117 for artificial intelligence (project 170500)24 August 2026: the project card sets discussion from 24 August to 8 September 2026 with entry into force on 1 March 2027; the press cites different dates
  20. FSTEC of Russia via regulation.gov.ru · Draft FSTEC order amending Order No. 117 for artificial intelligence (project 170500)24 August 2026: the draft moves models into a dedicated segment and requires strong authentication, prompt and response filtering, quotas and control over agent rights; the wording may change
  21. D-Russia · FSTEC published draft AI requirements for state information systems25 August 2026: an industry outlet first pointed to the draft and paraphrased it closely; a secondary source whose dates differ from the portal
  22. Kaspersky (Securelist) · Analyzing the vulnerability landscape in Q2 202626 August 2026: a quarterly report aggregates open-source agent vulnerabilities for the first time, with one agent ranking twelfth among projects; a vendor count from its own database
  23. FSTEC vulnerability database (BDU) · BDU: vulnerabilities in software for AI development4 September 2026: the threat database section on model software holds 951 records including popular assistants and libraries; the section also counts supporting components, not only tools
  24. LLAMATOR-Core (GitHub) · LLAMATOR-Core/llamator: Red Teaming python-framework for testing chatbots and GenAI systems4 September 2026: an open university red team framework supports attacks in Russian and English at version 3.5.0; there is no paper and no deployment data
Next

Related reading

This snapshot continues the analysis of agent stack configurations and the baseline on AI in software development: those cover the authority boundaries and the industry snapshot, this one covers what happened to those boundaries over a year.