Warnings from inside the industry are growing as some of the biggest names in artificial intelligence call for more time to address safety risks
The race to build increasingly powerful artificial intelligence systems is entering a new and more complicated phase. Some of the same people leading the development of advanced AI are now publicly discussing whether the industry is moving too fast.
Anthropic CEO Dario Amodei has called for companies to slow the pace of developing increasingly capable AI systems so safety measures have time to catch up. OpenAI CEO Sam Altman and Elon Musk have also expressed support for slowing parts of the race, according to Reuters.
The debate intensified after Anthropic researcher Jacob Coxon resigned and warned about the risks associated with increasingly powerful systems. His departure followed concerns from other researchers working at major AI companies about the possibility of systems eventually becoming difficult for humans to control.
Competition is part of the problem
One of the biggest challenges is that no company develops artificial intelligence in isolation. OpenAI, Anthropic, Google, Meta, xAI and other companies are competing for technological leadership while the United States is also trying to maintain an advantage over China.
That creates a dilemma: even companies concerned about safety may be reluctant to slow development if competitors continue moving forward. Amodei has argued that stronger coordination and safeguards will be necessary as AI systems become more capable.
The debate has now reached the White House. President Donald Trump said Sunday that concerns surrounding AI are being exaggerated by what he called “negative forces.” He said the United States should not give up its technological advantage over China, although he acknowledged that some regulation may be appropriate.
Researchers are looking beyond today’s chatbots
The warnings are not primarily about the AI tools millions of people currently use to write emails, generate images or answer questions. Researchers are looking at the next generations of systems, including AI capable of performing increasingly complex tasks with greater autonomy.
Among the concerns being discussed are cybersecurity, biological risks, autonomous decision-making and the possibility that future systems could become difficult to supervise. There is still significant disagreement among scientists, executives and policymakers about how likely the most extreme scenarios are.
What has changed is where the debate is happening. Concerns that once came mostly from outside the major AI companies are increasingly being raised by researchers and executives working inside the industry itself.
Source: Reuters, Associated Press, ABC News
