OpenAI and Musk Urge Caution Amid AI Market Surge

The comments come after several AI researchers raised concerns about the rapid development of advanced AI systems. Amodei also called for greater cooperation between the US, and China on AI safety.

US President Donald Trump, however played down the concerns during a visit to Ireland. He said the US is ahead of China in AI and wants to maintain that lead.

Amodei explained why he believes the AI industry should slow down and proposed a three part plan. One of his key suggestions is to give independent monitors continuous access to AI developers research processes.

Read More:Glenfarne Group Promotes Oliver Wood to Global Head of Projects

He said developing AI too quickly is reckless, and raised concerns about AI agents being used in harmful ways. Referring to the recent incident involving OpenAI agents and Hugging Face, Amodei warned that more powerful and poorly aligned AI systems could cause major damage, including potentially creating a large scale botnet. Some AI experts however, have questioned how realistic this scenario is.

Elon Musk supported Amodeis concerns saying, Dario is right. Musk also pointed to his earlier warnings about AI and the need to develop the technology carefully.

Amodeis comment's come as Anthropic prepares for a potential stock market listing. The company is reportedly planning an IPO that could value it at more than $2 trillion.

OpenAI CEO Sam Altman has backed Amodeis call to slow the pace of advanced AI development. In a post on X Altman said OpenAI also plans to give independent evaluators access to its research processes and will share more details soon.

Altman also said OpenAI does not plan to go public in 2026, arguing that the current AI safety environment makes an IPO unwise. He added that AI leaders from companies including Anthropic, Tesla, Meta and Google could eventually work together on a common approach to slowing development.

Demis Hassabis, co-founder and chair of Google DeepMind, also supported the direction of Amodeis plan, saying the details still need to be worked out.

However, some AI safety experts believe the proposal does not go far enough. David Krueger called for an immediate and indefinite international pause on the development of frontier AI systems.

Amodei’s plan asks the US government to allow major AI companies to work together on safety without facing antitrust penalties. David Sacks, a co-chair of Donald Trumps science, and technology advisory council rejected the idea and argued that AI companies also have strong business reasons to slow development because of potential legal risk's from harmful cyberattacks.

Meanwhile, King Charles is set to meet senior figures from leading AI companies on Thursday to discuss how AI can be developed responsibly under the theme AI for good.” One session called prudence at the frontier,” is expected to focus on setting clear limits on the use of AI for bioweapons and cyberattacks on critical infrastructure.

The meeting, organised by the Ditchley Foundation, is expected to include senior executives from OpenAI and Anthropic, Nvidia CEO Jensen Huang, Google DeepMind’s Demis Hassabis, IonQ CEO Niccolo de Masi, and Paolo Benanti, an adviser to the Pope on AI and technology ethics.

Read More:Box CEO Sells 15K Shares for $513K Following 52-Week High