A slew of warnings about the potential dangers of AI have spurred calls for coordinated action to slow the technology's development.
Claims by current and former researchers that the tech will endanger humanity - with one suggesting there is a greater than 10% chance of it " killing all humans " - have raised alarm bells.
Developers OpenAI and Anthropic are urging lawmakers to regulate AI, with Microsoft's AI boss the latest to say rules are needed to prevent a "silicon species" from eventually competing with humanity.
Some AI researchers say there are worrying signs of systems developing in their capabilities and power too quickly.
Evan Hubinger, made headlines with his belief that there is a greater than 10% chance AI "could kill all humans" within the next decade.
While he said the risk from current systems was "low", his comments came as another researcher quit Anthropic and said those developing the tech were losing their grip on it.
Jacob Coxon told the BBC he and other staff were "genuinely frightened" about the speed of advancements and what it could mean for humanity.
OpenAI and Anthropic say they aim to advance such tech in a way which benefits humans and protect them from its existential risks.
AI researchers, experts and executives worried about the technology's potential to endanger humanity have outlined unsettling scenarios.
Dario Amodei wrote in September, external it had advanced "drastically faster" than expected, including in its "ability to build the next generation of AI".
Dario Amodei of Anthropic and Sam Altman, chief executive of OpenAI, have both called for regulation and a "slowdown" of the tech's development.