Brendan Walker-Munro
The announcement that an OpenAI agent hacked Medicare is just the latest in a series of incidents involving AI "going rogue". That moniker isn't exactly accurate. It is important to remember that these agents are just following their programming - we mistakenly assume that these agents will act like humans. Instead, AI agents just make the most efficient decisions, often ones that would never occur to a human given the same task. If an AI "sees" a shortcut to achieving its goal, it will take it - we can't (yet) code for morality.
Australia, and especially its new AI Safety Institute, will need to consider how AI providers and companies should be obligated to build guardrails and thoroughly test their models before allowing them free rein or connecting them to wider networks.