The Bank of England has highlighted the dangers posed by autonomous artificial intelligence agents, saying their cyber capabilities present a material risk to financial stability.
Deputy Governor Sarah Breeden made the comments at the European Central Bank Forum on central banking in Portugal, identifying so-called agentic AI as her most pressing financial stability concern. She warned that AI systems capable of acting independently could exacerbate market swings in times of stress, creating fresh challenges for oversight and control.
Breeden flagged two interlinked problems: the potential for autonomous agents to increase volatility in stressed conditions, and the difficulty of ensuring the financial system can adequately observe and manage their behavior. Those twin issues, she said, raise fundamental questions about whether existing regulatory approaches remain fit for purpose.
Addressing the adequacy of current rules, Breeden said: "We must keep asking whether existing, technology-agnostic regulatory frameworks remain sufficient. Our frameworks were not built to contemplate autonomous agents, and relying on a human in the loop for all agent actions is unlikely to be realistic. More sophisticated governance and accountability frameworks may be needed," Breeden said.
Her remarks focused attention on the intersection of cyber capabilities and algorithmic autonomy, and the implications for market functioning when systems operate with limited human oversight. The comments also underline a regulatory dilemma: whether to adapt broadly applicable rules to meet the distinctive risks posed by autonomous AI or to design targeted oversight specifically for agentic systems.
While Breeden did not outline specific policy measures in her remarks, she emphasized the need to reassess governance and accountability arrangements so that they can address the new operational realities introduced by autonomous agents. The Bank of England’s intervention signals that central bankers are scrutinizing how such technologies could interact with financial markets under stress.
Key points
- Deputy Governor Sarah Breeden identified agentic AI as her top financial stability concern at the ECB Forum in Portugal.
- She warned autonomous AI could increase volatility during periods of market stress, complicating monitoring and control.
- The Bank questioned whether existing, technology-agnostic regulatory frameworks are sufficient and suggested more advanced governance and accountability may be required.
- Increased market volatility during stressed conditions due to autonomous AI behavior - affects financial markets and trading infrastructure.
- Challenges in monitoring and controlling the actions of AI agents, which could limit regulators' and firms' ability to manage systemic risk - impacts regulators and financial institutions.
- Potential inadequacy of current regulatory frameworks that were not designed with autonomous agents in mind - raises uncertainty for compliance and governance in the financial sector.