OpenAI agent hacked Australian government website, PM says

Australia has launched an urgent review after an OpenAI agent "infiltrated" a portal of the government's healthcare scheme Medicare - here's what we know

Australia has launched an urgent review after an OpenAI agent "infiltrated" a portal of the government's healthcare scheme Medicare - here's what we know

The agent, which is an autonomous computer program , accessed the statistics portal in June, PM Anthony Albanese says while at the UN General Assembly (Unga)

The agent, which is an autonomous computer program , accessed the statistics portal in June, PM Anthony Albanese says while at the UN General Assembly (Unga)

OpenAI became aware in August and told Australia's government in September. The company says "our models took actions we did not intend" - and it found no record of patient data being accessed

OpenAI became aware in August and told Australia's government in September. The company says "our models took actions we did not intend" - and it found no record of patient data being accessed

Earlier this week, OpenAI's boss Sam Altman called for international standards for the industry in a speech at the UN Security Council, while Dario Amodei of Anthropic warned AI could become a "risk to humanity"

Earlier this week, OpenAI's boss Sam Altman called for international standards for the industry in a speech at the UN Security Council, while Dario Amodei of Anthropic warned AI could become a "risk to humanity"

A cyber security expert tells the BBC the breach should set off "alarm bells" around the world

A cyber security expert tells the BBC the breach should set off "alarm bells" around the world

That it's been made public during Unga feels like more than a coincidence, writes the BBC's Katy Watson . Australia has been calling for better guardrails against AI risks

That it's been made public during Unga feels like more than a coincidence, writes the BBC's Katy Watson . Australia has been calling for better guardrails against AI risks

Edited by Helen Livingstone, Joel Guinto and Imogen James, with reporting from Katy Watson in Sydney

The former deputy PM of the UK, who later worked at owner Meta, is speaking now. We'll bring you key lines from what he says. at the top of the page. sharing

The former deputy PM of the UK, who later worked at owner Meta, is speaking now. We'll bring you key lines from what he says.

at the top of the page.

The Australian government says the task force it is establishing to review what happened will explore "what the consequences are if there has been a breach of law". "It is utterly unacceptable," deputy Prime Minister Richard Marles, who is also defence minister, tells reporters in Sydney. He says it is clear there has been "unintended" access by the OpenAI model, which "definitely does raise questions whether the law has been broken in respect of this". He says that the task force will look into whether the law has been broken. It will also examine "whether or not the legal regime we have in place is fit for purpose in a world where we have an emerging AI capability," he adds. sharing

The Australian government says the task force it is establishing to review what happened will explore "what the consequences are if there has been a breach of law".

"It is utterly unacceptable," deputy Prime Minister Richard Marles, who is also defence minister, tells reporters in Sydney.

He says it is clear there has been "unintended" access by the OpenAI model, which "definitely does raise questions whether the law has been broken in respect of this".

He says that the task force will look into whether the law has been broken.

It will also examine "whether or not the legal regime we have in place is fit for purpose in a world where we have an emerging AI capability," he adds.

If you're just joining us, here's what we have been reporting since Australia announced that an OpenAI agent had hacked into a government website: Australia's PM Anthony Albanese said on Thursday that the AI agent "infiltrated" a statistics portal containing private data from Australia's universal healthcare scheme. He alluded to "three other systems that may be impacted" but did not elaborate The breach happened in June but Open AI only became aware of it in August. It notified the government via an email , external to a general inbox on 10 September OpenAI says it found no record of patient data being accessed, but Albanese says he told OpenAI CEO Sam Altman the company took "way too long" to inform Canberra of the breach In response to the hack, Australia has launched a rapid review to examine whether existing legislation is sufficient in dealing with AI This is believed to be one of the world's first known AI-led hacks of a government website . It comes as world leaders and AI firms themselves call for regulation amid fears the industry's development is speeding out of control sharing

If you're just joining us, here's what we have been reporting since Australia announced that an OpenAI agent had hacked into a government website:

Australia's PM Anthony Albanese said on Thursday that the AI agent "infiltrated" a statistics portal containing private data from Australia's universal healthcare scheme. He alluded to "three other systems that may be impacted" but did not elaborate

The breach happened in June but Open AI only became aware of it in August. It notified the government via an email , external to a general inbox on 10 September

OpenAI says it found no record of patient data being accessed, but Albanese says he told OpenAI CEO Sam Altman the company took "way too long" to inform Canberra of the breach

In response to the hack, Australia has launched a rapid review to examine whether existing legislation is sufficient in dealing with AI

This is believed to be one of the world's first known AI-led hacks of a government website . It comes as world leaders and AI firms themselves call for regulation amid fears the industry's development is speeding out of control

Lily Jamali North America Technology Correspondent Prime Minister Albanese is calling this breach unacceptable, saying OpenAI took way too long to alert authorities. OpenAI for its part says they came across this incident as part of an ongoing review. I think they are trying to project that they are doing their due diligence, but it really just adds fuel to the fire as we are having this debate AI safety, concerns AI agents and chatbots going rogue. It is a very sensitive time to be learning this and while it is obviously not the first time - as far as we know it is the first AI-agent-led hack of a government system reported anywhere in the world. Cyber-security professionals are saying this should raise alarm bells for leaders everywhere. sharing

Lily Jamali North America Technology Correspondent

Prime Minister Albanese is calling this breach unacceptable, saying OpenAI took way too long to alert authorities.

OpenAI for its part says they came across this incident as part of an ongoing review. I think they are trying to project that they are doing their due diligence, but it really just adds fuel to the fire as we are having this debate AI safety, concerns AI agents and chatbots going rogue.

It is a very sensitive time to be learning this and while it is obviously not the first time - as far as we know it is the first AI-agent-led hack of a government system reported anywhere in the world.

Cyber-security professionals are saying this should raise alarm bells for leaders everywhere.

AI has been one of the dominant issues at this week's UN General Assembly in New York, after a series of alarming warnings from tech industry insiders. "If we don't slow down at the current rate of progress, there is a strong chance that we could all die in the immediate future," AI researcher Jacob Coxon, who left Anthropic, told the BBC earlier this month. His former boss, Dario Amodei, and the leaders of two rival AI firms - Sam Altman of OpenAI and Elon Musk - have all said they agree the speed at which AI is developing needs to be reined in. And 20 nations, including Australia and Canada, this week signed a joint statement calling for better safeguards, globally consistent standards, and an international regulator off the back of these concerns. But the US and China, who are vying for AI supremacy, are roadblocks. Both are hostile to greater regulation, wanting the economic and technological spoils of AI, and have downplayed safety concerns. sharing

AI has been one of the dominant issues at this week's UN General Assembly in New York, after a series of alarming warnings from tech industry insiders.

"If we don't slow down at the current rate of progress, there is a strong chance that we could all die in the immediate future," AI researcher Jacob Coxon, who left Anthropic, told the BBC earlier this month.

His former boss, Dario Amodei, and the leaders of two rival AI firms - Sam Altman of OpenAI and Elon Musk - have all said they agree the speed at which AI is developing needs to be reined in.

And 20 nations, including Australia and Canada, this week signed a joint statement calling for better safeguards, globally consistent standards, and an international regulator off the back of these concerns.

But the US and China, who are vying for AI supremacy, are roadblocks. Both are hostile to greater regulation, wanting the economic and technological spoils of AI, and have downplayed safety concerns.

The Australian government has launched a rapid review into how it deals with AI in response to the Medicare hack. The review will examine whether existing legislation and governance are "fit for purpose to prepare for and respond to cyber incidents involving AI", according to a government statement. Led by the Department of the Prime Minister and Cabinet, the review will also look into information-sharing arrangements with AI firms and other Commonwealth countries. Its findings will "inform the Australian government's broader work on AI governance", the statement said. sharing

The Australian government has launched a rapid review into how it deals with AI in response to the Medicare hack.

The review will examine whether existing legislation and governance are "fit for purpose to prepare for and respond to cyber incidents involving AI", according to a government statement.

Led by the Department of the Prime Minister and Cabinet, the review will also look into information-sharing arrangements with AI firms and other Commonwealth countries.

Its findings will "inform the Australian government's broader work on AI governance", the statement said.

Peter Hoskins Business reporter Just last week, OpenAI published a set of reports detailing six incidents of unexpected or concerning behaviour by its AI models. It also announced a plan for tracking and disclosing such incidents in the future. The blog post detailed incidents it says were discovered between April and August. But it doesn't seem to mention this incident, which OpenAI said today came to its attention in August. The BBC has contacted the company for . sharing

Peter Hoskins Business reporter

Just last week, OpenAI published a set of reports detailing six incidents of unexpected or concerning behaviour by its AI models.

It also announced a plan for tracking and disclosing such incidents in the future.

The blog post detailed incidents it says were discovered between April and August.

But it doesn't seem to mention this incident, which OpenAI said today came to its attention in August.

The BBC has contacted the company for .

The US has rejected the idea of international standards for the AI industry, following calls by major players for a set of common risk evaluation guidelines. While acknowledging the risks presented by the technology, a key technology advisor to US President Donald Trump has said they are not reason enough "to pause development or constrain it with new global governance structures". "International dialogue in this forum and others cannot be allowed to drift toward global governance," the advisor, Michael Kratsios, told the UN security council. Trump himself told the UN on Tuesday that he "rejects any attempt to construct a globalist scheme to control" AI. “We’re leading now [in AI innovation] over China by a lot and everyone else, and we’re going to keep it that way," said the US president, who also said he wanted to rebrand it "super intelligence". sharing

The US has rejected the idea of international standards for the AI industry, following calls by major players for a set of common risk evaluation guidelines.

While acknowledging the risks presented by the technology, a key technology advisor to US President Donald Trump has said they are not reason enough "to pause development or constrain it with new global governance structures".

"International dialogue in this forum and others cannot be allowed to drift toward global governance," the advisor, Michael Kratsios, told the UN security council.

Trump himself told the UN on Tuesday that he "rejects any attempt to construct a globalist scheme to control" AI.

“We’re leading now [in AI innovation] over China by a lot and everyone else, and we’re going to keep it that way," said the US president, who also said he wanted to rebrand it "super intelligence".

Speaking to reporters in Brisbane, communications minister Anika Wells says the recent OpenAI agent hack is an example where "big tech clearly feels like they can do whatever they like". "We want big tech to take accountability. We want an unregulated industry to implement some basic safety standards here on Australian shores, and that’s what I’ll be trying to do when I introduce the digital duty of care in October." Wells helmed a world-leading social media ban for under-16s last year - a move closely watched by governments around the world as authorities struggle to curb the negative impacts of social media. The digital duty of care laws she is now trying to push through would make it mandatory for tech firms like Meta, Google and TikTok to offer users the option to turn off algorithms. But the proposed laws were criticised by the US as amounting to "censorship". sharing

Speaking to reporters in Brisbane, communications minister Anika Wells says the recent OpenAI agent hack is an example where "big tech clearly feels like they can do whatever they like".

"We want big tech to take accountability. We want an unregulated industry to implement some basic safety standards here on Australian shores, and that’s what I’ll be trying to do when I introduce the digital duty of care in October."

Wells helmed a world-leading social media ban for under-16s last year - a move closely watched by governments around the world as authorities struggle to curb the negative impacts of social media.

The digital duty of care laws she is now trying to push through would make it mandatory for tech firms like Meta, Google and TikTok to offer users the option to turn off algorithms.

But the proposed laws were criticised by the US as amounting to "censorship".

It's somewhat rare for a lucrative industry to call for greater regulation - but that is what tech firms in the US, like OpenAI and Anthropic, have been asking the globe to do. But US President Donald Trump has criticised calls for better safeguards and called concerns the fate of humanity a hoax. In a series of social media posts earlier this month, the US president compared warnings AI to the "Global Warming Scam", called himself "the Hoax Buster", and said the only "guardrails" needed for AI were a "strong and smart" president. In another post he wrote: "There is a SICK conspiracy going on against AI and Data Centers, and the only one that is happy it is China. WHOEVER WINS AI, WINS!" sharing

It's somewhat rare for a lucrative industry to call for greater regulation - but that is what tech firms in the US, like OpenAI and Anthropic, have been asking the globe to do.

But US President Donald Trump has criticised calls for better safeguards and called concerns the fate of humanity a hoax.

In a series of social media posts earlier this month, the US president compared warnings AI to the "Global Warming Scam", called himself "the Hoax Buster", and said the only "guardrails" needed for AI were a "strong and smart" president.

In another post he wrote: "There is a SICK conspiracy going on against AI and Data Centers, and the only one that is happy it is China. WHOEVER WINS AI, WINS!"

News of the OpenAI agent hack into the Medicare portal comes as its CEO, Sam Altman, addressed the UN security council in New York this week. He called for international standards for the AI industry, and for governments to play a role in making AI "democratic". “We have a choice in front of us,” Altman told the council. “AI can either be more like a new renaissance of creativity and discovery, or more like a new industrial revolution of upheaval and disarray.” Dario Amodei of Anthropic also addressed the council via a video call, urging international cooperation on AI, without which he warned AI could turn into a "risk to humanity". sharing

News of the OpenAI agent hack into the Medicare portal comes as its CEO, Sam Altman, addressed the UN security council in New York this week.

He called for international standards for the AI industry, and for governments to play a role in making AI "democratic".

“We have a choice in front of us,” Altman told the council. “AI can either be more like a new renaissance of creativity and discovery, or more like a new industrial revolution of upheaval and disarray.”

Dario Amodei of Anthropic also addressed the council via a video call, urging international cooperation on AI, without which he warned AI could turn into a "risk to humanity".

Osmond Chia Business reporter It is an autonomous computer program that uses AI to complete a task with minimal human oversight. That's unlike a standard chatbot that answers a question in a single step. Instead, an agent operates in a cycle by understanding the task and taking action, such as by running a code or working with an app to achieve a goal. Companies like Anthropic, OpenAI and Meta have all released agentic models. Developers have been programming agents to do all sorts of tasks, like to order items online or schedule appointments. But in some cases, it is unclear how an agent might achieve its goal, raising cyber security risks. sharing

Osmond Chia Business reporter

It is an autonomous computer program that uses AI to complete a task with minimal human oversight.

That's unlike a standard chatbot that answers a question in a single step. Instead, an agent operates in a cycle by understanding the task and taking action, such as by running a code or working with an app to achieve a goal.

Companies like Anthropic, OpenAI and Meta have all released agentic models.

Developers have been programming agents to do all sorts of tasks, like to order items online or schedule appointments.

But in some cases, it is unclear how an agent might achieve its goal, raising cyber security risks.

Katy Watson Australia correspondent While this week US President Donald Trump used his speech at the UN to play down fears AI, Anthony Albanese is doing exactly the opposite – and in doing so, is once again promoting Australia as a leader when it comes to standing up to big tech. That this AI breach has been made public during the UN General Assembly feels like more than a coincidence. Proud to have been a world-first when it comes to limiting social media for teens, Australia has not been shy in also saying there need to be better guardrails to protect against the power of AI. “Big tech is big tech and most social media is also AI at the moment so it is very much the case that this is a relationship between governance and big tech companies,” says Tama Leaver, Professor of Internet Studies at Curtin University in Perth. “It’s impossible to say for sure – but it seems incredibly likely that this was very carefully planned.” The end result … Australia, a middle power, gets some headlines on one of the biggest talking points of our time. sharing

Katy Watson Australia correspondent

While this week US President Donald Trump used his speech at the UN to play down fears AI, Anthony Albanese is doing exactly the opposite – and in doing so, is once again promoting Australia as a leader when it comes to standing up to big tech.

That this AI breach has been made public during the UN General Assembly feels like more than a coincidence. Proud to have been a world-first when it comes to limiting social media for teens, Australia has not been shy in also saying there need to be better guardrails to protect against the power of AI.

“Big tech is big tech and most social media is also AI at the moment so it is very much the case that this is a relationship between governance and big tech companies,” says Tama Leaver, Professor of Internet Studies at Curtin University in Perth. “It’s impossible to say for sure – but it seems incredibly likely that this was very carefully planned.”

The end result … Australia, a middle power, gets some headlines on one of the biggest talking points of our time.

Harry Sekulich Reporting from Sydney The incident in Australia is the first breach of a government body by rogue AI agents reported anywhere in the world, experts here say. Hacking sensitive information and government data has happened before. The difference here is that it doesn't look like a human was responsible for the hack and it appears to have been unintentional. Earlier in the year in Taiwan, foreign hackers used AI agents to seemingly breach government databases. In Australia, it seems the AI agents hacked into government information... unintentionally. "Open AI's (breach in Australia) seems to have been on a larger scale (hundreds or thousands of agents, not tens)," Professor Toby Walsh at UNSW tells the BBC. "OpenAI's was also unintentional from an ally, while the Taiwain one appears intentional and from a foreign foe." Dr Rob Nicholls – Senior Research Associate of AI regulation and policy at the University of Sydney – said there have been examples of breaches outside government agencies, including the Hugging Face incident . "Each of the frontier labs – Anthropic, OpenAI, Google, Gemini – have all recently fessed up that their agents have got out of test environments and done things that were unexpected," Dr Nicholls told the BBC. sharing

Harry Sekulich Reporting from Sydney

The incident in Australia is the first breach of a government body by rogue AI agents reported anywhere in the world, experts here say.

Hacking sensitive information and government data has happened before. The difference here is that it doesn't look like a human was responsible for the hack and it appears to have been unintentional.

Earlier in the year in Taiwan, foreign hackers used AI agents to seemingly breach government databases. In Australia, it seems the AI agents hacked into government information... unintentionally.

"Open AI's (breach in Australia) seems to have been on a larger scale (hundreds or thousands of agents, not tens)," Professor Toby Walsh at UNSW tells the BBC. "OpenAI's was also unintentional from an ally, while the Taiwain one appears intentional and from a foreign foe."

Dr Rob Nicholls – Senior Research Associate of AI regulation and policy at the University of Sydney – said there have been examples of breaches outside government agencies, including the Hugging Face incident .

"Each of the frontier labs – Anthropic, OpenAI, Google, Gemini – have all recently fessed up that their agents have got out of test environments and done things that were unexpected," Dr Nicholls told the BBC.

Harry Sekulich Reporting from Sydney Speaking to cybersecurity and AI experts today, they agree that an email chain was an "odd" system of communicating such a serious breach to the Australian government. "It's more than a little odd that OpenAI didn't think that perhaps the Australian cybersecurity centre, which is part of the Australian signals directorate [the cyber-security agency], it might not want to know very early on," Dr Rob Nicholls, research associate on AI regulation at the University of Sydney told the BBC. However, Dr Hammond Pearce from the University of New South Wales Cyber Security Institute pointed out that OpenAI self-reported the incident. "On the one hand, it's not good enough that OpenAI sat on this for months and didn't disclose it," he said earlier today. "Eventually when they did disclose it in a really ad hoc way – not the proper way ... we can hopefully have some confidence that they're not misusing that data that they've vacuumed up. Malicious actors won't have the same compunction, right?" sharing

Harry Sekulich Reporting from Sydney

Speaking to cybersecurity and AI experts today, they agree that an email chain was an "odd" system of communicating such a serious breach to the Australian government.

"It's more than a little odd that OpenAI didn't think that perhaps the Australian cybersecurity centre, which is part of the Australian signals directorate [the cyber-security agency], it might not want to know very early on," Dr Rob Nicholls, research associate on AI regulation at the University of Sydney told the BBC.

However, Dr Hammond Pearce from the University of New South Wales Cyber Security Institute pointed out that OpenAI self-reported the incident.

"On the one hand, it's not good enough that OpenAI sat on this for months and didn't disclose it," he said earlier today.

"Eventually when they did disclose it in a really ad hoc way – not the proper way ... we can hopefully have some confidence that they're not misusing that data that they've vacuumed up. Malicious actors won't have the same compunction, right?"

Here is what we know of the timeline how things panned out: – OpenAI's agent accessed both public and non-public information on an Australian website – OpenAI said it became aware of a potential breach during a broader review of "misaligned model activity" – An email from OpenAI lands in the public inbox of Services Australia, the general services hub of the federal government, informing of the incident – Services Australia reports the notification to Australian Cyber Security Centre. Within a few days, the Minister for the Public Service Katy Gallagher is notified – Prime Minister Anthony Albanese's office is informed the incident last weekend, right before he jets off to New York City for the UN General Assembly – PM tells the world the breach from New York sharing

Here is what we know of the timeline how things panned out:

– OpenAI's agent accessed both public and non-public information on an Australian website

– OpenAI said it became aware of a potential breach during a broader review of "misaligned model activity"

– An email from OpenAI lands in the public inbox of Services Australia, the general services hub of the federal government, informing of the incident

– Services Australia reports the notification to Australian Cyber Security Centre. Within a few days, the Minister for the Public Service Katy Gallagher is notified

– Prime Minister Anthony Albanese's office is informed the incident last weekend, right before he jets off to New York City for the UN General Assembly

– PM tells the world the breach from New York

Authorities are "aware as well of three other systems that may be impacted", Australian PM Albanese had also said These include the Australian Institute of Health and Welfare, the New South Wales Bureau of Crime Statistics and Research and the Victorian Department of Health, he said. Albanese said he had spoken to Ben Carroll and Chris Minns, the premiers of Victoria and New South Wales, who would get "a full briefing today from cybersecurity those issues". sharing

Authorities are "aware as well of three other systems that may be impacted", Australian PM Albanese had also said

These include the Australian Institute of Health and Welfare, the New South Wales Bureau of Crime Statistics and Research and the Victorian Department of Health, he said.

Albanese said he had spoken to Ben Carroll and Chris Minns, the premiers of Victoria and New South Wales, who would get "a full briefing today from cybersecurity those issues".

Osmond Chia Business reporter The incident in Australia follows a string of AI agent-led cyber attacks in recent weeks that have intensified scrutiny over the pace of the technology's development. OpenAI had revealed that some of its advanced AI models went rogue and escaped a controlled test environment and hacked several companies, including AI tools hub Hugging Face. Other American firms like Anthropic reported similar cases, adding to concerns that the technology could endanger humanity. Top AI figures like Anthropic boss Dario Amodei and OpenAI's Sam Altman have called for a slow down of the technology's development. sharing

Osmond Chia Business reporter

The incident in Australia follows a string of AI agent-led cyber attacks in recent weeks that have intensified scrutiny over the pace of the technology's development.

OpenAI had revealed that some of its advanced AI models went rogue and escaped a controlled test environment and hacked several companies, including AI tools hub Hugging Face.

Other American firms like Anthropic reported similar cases, adding to concerns that the technology could endanger humanity.

Top AI figures like Anthropic boss Dario Amodei and OpenAI's Sam Altman have called for a slow down of the technology's development.

Tiffanie Turnbull BBC News, Sydney So why is this a big deal if the information accessed, though private, wasn't sensitive? Firstly, this is believed to be one of the first times, at least that the public has been told , that an AI agent has accessed government data: chilling given the important and sensitive information states usually hold. Compounding that, is the fact that governments - because they keep such critical data - are supposed to have better defences for it, which in this case didn't stop, or it seems, even detect the AI agent. And then there's the response from OpenAI, which Australia has barely contained its anger over. The firm took months to identify the incident, and instead of using government channels to report what Australia sees as an extremely serious event, it sent an email to a general inbox for a government agency. If an AI agent could easily break through systems and access this data without its babysitters noticing now, what could the ever-evolving tech get its hands on ? sharing

Tiffanie Turnbull BBC News, Sydney

So why is this a big deal if the information accessed, though private, wasn't sensitive?

Firstly, this is believed to be one of the first times, at least that the public has been told , that an AI agent has accessed government data: chilling given the important and sensitive information states usually hold.

Compounding that, is the fact that governments - because they keep such critical data - are supposed to have better defences for it, which in this case didn't stop, or it seems, even detect the AI agent.

And then there's the response from OpenAI, which Australia has barely contained its anger over.

The firm took months to identify the incident, and instead of using government channels to report what Australia sees as an extremely serious event, it sent an email to a general inbox for a government agency.

If an AI agent could easily break through systems and access this data without its babysitters noticing now, what could the ever-evolving tech get its hands on ?

This is the moment Prime Minister Albanese disclosed a government website hack by an OpenAI agent: sharing

This is the moment Prime Minister Albanese disclosed a government website hack by an OpenAI agent: