Why the AI Merchants of Doom are Dead Wrong

 Recent discussions among AI researchers have raised alarms about the potential risks of artificial intelligence to humanity. Some experts claim that advanced AI could pose an extinction risk by the end of the decade, while others challenge the legitimacy of these concerns.

1. Resignation and Concerns:

Jacob Coxon, a researcher from Anthropic, recently resigned, expressing fears that AI technologies could threaten human survival. Another employee, Evan Hubinger, suggested a significant chance of this risk occurring within ten years.

2. Fear Factors:

The primary concerns about AI revolve around two scenarios:

Loss of Control: Highly intelligent AI systems may develop their own goals and inadvertently harm humanity.

Human Misuse: Individuals could use advanced AI for malicious purposes, such as creating dangerous viruses.

3. Debunking AI Threats:

The idea of an AI-created doomsday virus is dismissed, as the mechanisms for creating harmful viruses have already been researched.

The notion that AI can self-replicate and override human control lacks credibility, given the complexities involved in creating advanced AI hardware.

4. Physical Threats:

Current AI technology is considered too rudimentary to cause significant physical harm. Any potentially dangerous AI would take decades to develop and would likely be manageable before posing a real danger.

5. Reasons for Scaremongering:

Possible motivations behind the fear of AI include:

Researchers might genuinely believe in the threats due to their intense focus.

Larger companies might use scare tactics to push for stricter legislation, maintaining their dominance over emerging competitors.

Political agendas may utilize AI concerns to sway public support or influence elections.

The fears surrounding AI doomsday narratives are viewed as exaggerated hype. It is essential to critically evaluate these claims and not succumb to unfounded fears, similar to past climate alarmism. The reality of AI threats seems less dire than portrayed by alarmist narratives.

https://wattsupwiththat.com/2026/09/11/why-the-ai-merchants-of-doom-are-dead-wrong/