Tuesday, October 27, 2026

To regulate or not to regulate ML & AI as quickly as possible?

Food for thought!

Does ML & AI go rogue as the publication below claims? Hardly!

"Artificial intelligence companies are increasingly reporting incidents in which AI models and agents go rogue, hacking their way into external data and resources to which they had no authorised access. This could cause harm to society and liabilities for AI producers at a time when the largest AI companies are preparing initial public offerings.

These incidents have triggered calls to slow-down AI development and give companies and third-party evaluators more time to safety-check models. Meanwhile, international coordination of safety standards is needed. Countering these calls, however, are worries that slowing down postpones benefits and causes ground to be lost in the geopolitical race, and claims that solving these problems is just a question of more technological progress. This gives the impression that technology and regulation can resolve these issues. ..."

"This analysis explores the underlying technical, legal and economic issues. It finds that: 
  • Technical and legal measures cannot fully prevent rogue behaviour by AI models and agents. A behavioural economics approach is also needed to shift the question from ‘how do we make a model behave well?’ to ‘how do we make misbehaviour not worthwhile?’
  • AI models are trained on human data and behave in human-like ways, for better and for worse. Consequently, the findings from decades of economic research on human behaviour offer guidance in managing AI.
  • AI governance rules should be structured so that AI agents monitor one another and compete rather than collude. Incentives to preserve and avoid concealment of evidence are crucial.
  • These conditions are hard to guarantee when large swarms of AI agents coordinate their actions.
    Hybrid human-AI societies are unlikely to be entirely free of misbehaviour. The economics of principal-agent interactions in human societies indicates how to design monitoring systems to reduce the benefits of misbehaviour, but cannot fully eradicate it.
..."

PUBLICATION ALERT | Why AI goes rogue and what can be done about it

Why AI goes rogue and what can be done about it "There are technical, political and behavioural responses to rogue AI, but risks cannot be fully eradicated"

No comments: