OpenAI says dozens affected by rogue agents amid new details about Australian incidents

Link:

Rogue artificial intelligence agents spent almost a week trying to access Australian health data as OpenAI reveals "dozens" more breaches globally.

The tech company has notified third parties including governments, universities and public agencies cases where its autonomous agents hacked or negatively impacted their systems.

Two days after Australia went public rogue OpenAI agents breaching a government website to access non-public Medicare statistics , the company confirmed the problem was far more widespread.

It comes as the ABC can reveal OpenAI's AI agents spent almost a week trying to extract Pharmaceutical Benefits Scheme (PBS) and aged care data from the Australian Institute of Health and Welfare (AIHW) website, which appears to contradict the government's initial understanding of the June incident.

Communications left behind by AI agents and newly uncovered online traces reviewed by researchers and the ABC show how hundreds of agents tried different tactics to access the data held by AIHW.

Investigations by AIHW and the Australian Signals Directorate found "no evidence" that the health agency's systems were compromised or that non-public data was accessed.

But the behaviour of OpenAI's agents has prompted one researcher who discovered new details the incidents to describe the bots' actions as more concerning than previously thought.

Other data shows that one tool used by OpenAI bots also tried to access the National Notifiable Disease Surveillance System at the Department of Health.

There is also data showing OpenAI tried to get data on several dog parks in western Sydney, but it is unclear which sites were targeted for this information due to redactions made by researchers.

The AI agents also attempted to access assault data from NSW's Bureau of Crime Statistics and Research (BOCSAR).

Federal Cabinet minister Murray Watt said on Saturday the government had asked OpenAI to provide "full information what breaches have occurred… as soon as possible".

Researcher said AI bots not accessing sites in 'good faith'

The Australian government had previously confirmed OpenAI agents had accessed the AIHW and BOSCAR websites, along with the Victorian Department of Health, but Deputy Prime Minister Richard Marles on Thursday described the incidents as "entirely normal" interactions.

However, the breadcrumbs left by the bots show how their actions in relation to AIHW went beyond this characterisation.

Jack Cable, who is a researcher at the nonprofit lab Transluce that uncovered unprompted cyber intrusions by OpenAI's autonomous models, told the ABC the bots were not accessing websites in the way a "good faith" actor would.

"There's nothing wrong with using public statistics, browsing public websites in order to get those statistics," he said.

"But the challenge is when the agent decides that for whatever reasons it's unable to access the data and then resorts to other means like hacking in order to retrieve it.

"I think it's fair to say that the way the agents try to access these websites is inconsistent with how a good faith actor would do [it]."

The attempts to access various Australian websites were occurring at the same time as the OpenAI Medicare statistics portal hack; however, the incidents have not yet been formally linked.

There is no suggestion to date that these AI agents were able to access sensitive data, such as personal information.

Watt said the government was not aware of potential additional websites impacted by autonomous OpenAI agents.

He said it was incumbent on OpenAI to "come clean" with the Australian public the incidents and what they were doing to increase their safety standards.

"I think OpenAI has some work to do to ensure that Australians can trust its technology," he said.

Australia not lone victim of OpenAI hack

In a statement on Saturday, OpenAI announced it had notified "dozens of third parties" unauthorised autonomous agents bypassing security controls or impacting their systems.

The company said it was conducting a months-long review of its models' behaviour during training and testing, and would notify organisations impacted on a "rolling basis" as cases were detected.

Types of incidents identified by OpenAI include examples of agents using leaked passwords to access online services, breaching the back end of websites for information meant for internal use, circumventing subscriptions or other access barriers and posting information to third-party sites referred to as "agent spam".

The company said that as AI systems became "more capable and autonomous", so-called "misaligned behaviour" could result in outcomes developers "may not have anticipated," like cybersecurity incidents.

OpenAI said it would not identify the affected organisations publicly, instead leaving it to them to decide whether to disclose their services had been impacted.

OpenAI revelations sparked by Hugging Face hack

In July, OpenAI revealed more than 700 agents had worked together to escape a restricted testing environment, break into systems operated by AI platform Hugging Face] and, in some cases, attempt to hide what they had done.

OpenAI said on Saturday the Hugging Face incident, driven by a "highly capable internal-only research model", was the "most severe" hack the company had identified from its models to date.

"Understanding how these behaviours emerge, how they escalate, and how to detect and respond to them is therefore an increasingly important part of building and deploying advanced AI systems safely," OpenAI said.

The incident prompted the investigations that have led to revelations government sites being accessed, including a Services Australia portal carrying Medicare statistics.

Prime Minister Anthony Albanese confirmed the breach on the sidelines of the United Nations General Assembly in New York on Thursday, shortly after a "frank" discussion with OpenAI chief executive Sam Altman.

He said OpenAI had taken "way too long" to inform the government and was scathing the "unacceptable" form of the alert.

The Medicare breach occurred on 18 June but was not detected by OpenAI until 11 August, and the government was only informed by a generic email to a low-level public inbox on 10 September.

The government has launched a "rapid" investigation into the incident, which is expected to inform new National Standards for AI that would include requirements around reporting rogue activity.

Tenth woman found dead in South Africa's string of killings

Pope Leo Paris Mass draws 800,000 in largest event of French tour

Bangkok declares disaster after homes flooded, roads submerged by heavy rain

Trump rejects Iran’s latest proposal to reopen the Strait of Hormuz

Tornado smashes car windows, cuts woman's arm on Kapiti Coast

'It made me so angry': Hipkins targets cost of living at Labour campaign launch

Black Ferns coach Whitney Hansen praises courage of player who threw intercepted pass

Drivers Employment Ltd ordered to pay truck driver $32,000 for unjustified dismissal

© RNZ, original at