Skip to main content

Microsoft warns uncontrolled AI could create silicon species

Microsoft AI head Mustafa Suleyman warns that uncontrolled AI development could create a silicon species rivaling humans and criticizes Anthropic.

AI-written
Inewgen
17 Sep 2026Source: BBC Business3 min read (0 views)
Share
Microsoft warns uncontrolled AI could create silicon species

Stock photo for illustration only, not from the actual event

Font size
  • Microsoft AI head Mustafa Suleyman warns against unchecked AI development risks.
  • He criticizes rival Anthropic for anthropomorphizing AI systems.
  • Stresses that AI lacks consciousness and is merely a sequence completion engine.
  • Microsoft formed its own superintelligence team in October 2025 to ensure safety.

The head of Microsoft AI has issued a stark warning that without adequate safeguards, the rapid progression of artificial intelligence could result in the emergence of a new "silicon species" capable of competing directly with human beings. Speaking on the Today programme on Thursday, Mustafa Suleyman cautioned against tech firms continuing to build AI systems endowed with the ability to set their own objectives, earn money, and own assets.

During his remarks, Suleyman specifically criticized rival firm Anthropic, describing its approach as misguided. He pointed out that teaching AI to exhibit human-like qualities—a practice known as anthropomorphising—falsely creates the impression that models like Claude possess their own desires, values, and sense of self, ultimately driving technology toward a point where humanity loses control.

"AIs are not conscious. They do not feel, experience, or suffer. They do not have innate preferences or underlying motivations. They are sequence completion engines, internally hollow, designed to follow instructions, and accomplish goals set by humans."

Mustafa Suleyman

Emphasizing the technical reality behind the systems, Suleyman noted that AI models do not experience suffering, possess innate preferences, or harbor underlying motivations. To mitigate these risks, the Microsoft chief called for greater transparency regarding how AI models are trained and evaluated, alongside independent scrutiny of their behavior and stronger monitoring tools.

The debate surrounding AI alignment and autonomy highlights a deep philosophical split within the tech industry regarding how safe boundaries should be established. While some firms experiment with human-like interactions to improve user experience, Microsoft's leadership argues that such practices blur crucial lines of distinction. The creation of Microsoft's superintelligence team in October 2025 illustrates an institutional effort to codify strict limits ensuring advanced models remain permanently subordinate to human oversight.

The debate over how much autonomy AI systems should possess continues to divide industry leaders, echoing similar safety concerns recently raised by OpenAI executives. In response to these challenges, Microsoft established its dedicated superintelligence team in October 2025 to ensure advanced technologies remain strictly within human-controlled operational boundaries.

Source: BBC Business

Comments

Leave a Comment
0/2000

Found something wrong in this article? Report an issue with this article