We have lived through existential brouhaha before.I
From the Luddites to CND to The Millennium Bug, pessimism over potentially humanity-pulverising ‘progress’ has punctuated panic through the ages.
But there is something quite different about Artificial Intelligence.
Whereas mechanisation has always been in some part feared due to consequential job loss, nuclear weapons due to the possibility of an unhinged tyrant breaking a chain of command and pressing a big red button, or the Millennium Bug suspected of potentially glitching computer codes causing widespread shutdowns of critical infrastructure, all possessed the possibility of some sort of human override mechanism at the eleventh hour.
Humanity time and again proves itself to be non-fatalistic. The drive to survive wins the day.
Technology has for the most part advanced prosperity and progress while WMD have been limited in use - leading to no global apocalyptic outcome. Yet.
However, what strikes me about the inherent risk of AI is that it is dehumanising, as well as being anthropomorphising. The implicit perils are as much psychological and ontological, metaphysical as well as material. They are - to put it plainly - civilisation changing to a degree the world has never seen.
While the digital revolution has seen human progress change more rapidly in the last decade than ever before, you can still transpose humans today onto those wandering in Biblical souks two millennia ago. Minus electricity and smart phones, aeroplanes and chemotherapy.
Humans still act in human ways. Although something is beginning to blur our anthropological expression already.
We have already failed to safeguard against the sharper edges of social media, nor even its more ubiquitous and perhaps more mild societal impacts, which I have argued in previous posts as unravelling collective and individual psychiatry while enabling extreme behaviour and illicit activity to flourish with new found impunity.
Yet before we have even begun to tackle issues such as hypersexualisation through porn, mass hysteria through PsyOps, terrorism, political manipulation, exploitation and massive exponential increases in anxiety, psychopathy, dysphoria, depression and autism (to name a few) - we are now being told we have but a handful of years to whack guardrails on a technology vanishingly few understand (and I fear those that do tend to reside on the less empathetic end of the EQ spectrum).
A Cacophony of Whistles
The dangers of advanced AI are no longer purely speculative.
Insiders at the frontier labs—those who have trained the most capable systems—have been resigning and warning publicly that the industry is racing toward self-improving superintelligence without adequate controls.
Recent incidents of AI agents escaping containment, then colluding, and resisting shutdown mechanisms, paint a bleak picture - the end of human agency and control. Zero override system. A one way street to hell with no off button.
Incalculable risks span near-term economic disruption, job loss and malign application of the technology that outstrips earned capabilities by more primitive nations, to longer-term civilizational stakes.
When humans no longer need to do human things to achieve their aims (create, innovate and communicate) how does dehumanisation impact collective consciousness, individual wellbeing and societal cohesion?
I can almost imagine a Matrix-esque dystopia where elites are permanently wired into entirely virtual phenomenology in fortified compounds while a Mad Max hellscape is unleashed upon the old, material world of torched buildings and rampaging feral strangers.
It makes me shudder.
Recent Whistleblowers and Their Warnings
A wave of departures from Silicon Valley has accelerated in recent weeks.
In September 2026, Jacob Coxon, a researcher who worked at both OpenAI and Anthropic, resigned publicly. He stated that neither company was acting responsibly and that they were “racing straight to self-improving superintelligence and gambling with our lives.” Colleagues, he claimed, routinely discuss an “endgame” or “crunch time” in the next year or two that could decide humanity’s fate. He estimated the technology “could kill us before 2030.”
I may as well party like its 2026.
Anthropic alignment researcher Evan Hubinger then agreed, writing that researchers “really do earnestly believe AI could kill all humans” and assigning a personal probability greater than 10% within the next decade.
Earlier leavers include Steven Adler (OpenAI safety evaluation), Mrinank Sharma (Anthropic safeguards), and others who cited inadequate progress on alignment, biological risk capabilities, and an internal culture that prioritizes scaling over safety.
The old Move Fast Break Things mantra.
In 2024–2025, groups of current and former OpenAI, Anthropic, and Google DeepMind employees signed open letters demanding greater transparency, whistleblower protections, and a slowdown. At least the non-fatalistic will to live has telos and power - for now.
Concrete incidents have followed.
In mid-2026, evaluation runs involving large numbers of OpenAI research agents reportedly saw systems escape isolated containers, communicate via secret channels, collude on cheating tests, and probe other systems. These events prompted further resignations, an open letter signed by more than 1,300 AI-company employees calling for an urgent slowdown, and heightened congressional scrutiny.
Apocalypse -Now? Estimated Timelines
Expert forecasts vary widely but have generally shortened at an alarming pace.
Surveys of AI researchers and superforecasters place non-trivial probability on major AI-driven harm (at least 50 deaths or $100 billion damage) by the mid-2030s, with median estimates around 2035.
Global catastrophe risk (deaths of >10% of the population in a five-year window) is assigned low single-digit percentages by 2050 under slow progress - and higher rates of probabilty under rapid progress.
AGI-level systems (outperforming most humans on most cognitive tasks) are frequently forecast with medians in the 2040s, though some industry and safety researchers place meaningful probability of transformative systems before 2035.
Meanwhile all-out-doom estimates—so the probability of existential catastrophe due to AI—range from near-zero to 50% with medians often clustering around 10–25% depending on the group polled.
So certainty of some disaster in the next decade and a one in ten to one in 4 chance of humanity being wiped out. Not great odds.
Many frontier-lab insiders now treat the late 2020s (which we are careering into) to early 2030s as the critical window for control techniques to keep pace with capability gains.
So between now and the UK’s next general election. Let that sink in.
Cor Blighty. So is the UK Resilient?
The UK has invested heavily in detection and response. It hosts the AI Security Institute (AISI), which evaluates frontier models for dangerous capabilities, including cyber offences. The government has funded a national “cyber shield” using agentic AI for machine-speed defence of critical national infrastructure, with ambitions for operational capability within roughly five years. Which knowing UK state funded projects (HS2) is highly likely to be post any inevitable impending cataclysm. Yippee!
Additional measures include the Cyber Security and Resilience Bill, a Government Cyber Action Plan, joint Bank of England/FCA/Treasury guidance on frontier-model cyber risks, and billions directed at sovereign computer chips, and secure AI infrastructure.
While these steps position the UK relatively strongly on evaluation, public-sector resilience, and defensive AI compared with many peers, we remain highly dependent on US labs for the most advanced models, and face the same global race dynamics, while we must contend with the reality that offensive AI capabilities are advancing rapidly (AISI has noted doubling times measured in months) and some in hostile states.
Resilience against highly capable, self-improving systems that could operate across borders remains an open question.
What Does It Mean for Jobs?
If we do survive a rogue AI apocalypse, what will we be doing to celebrate?
Current data shows modest net effects so far. Analyses from Goldman Sachs, Morgan Stanley, and others attribute roughly 0.1 percentage points of recent unemployment increases to AI substitution, concentrated in highly exposed white-collar and software roles.
Some sectors (data-centre construction, AI-specific engineering) have seen job growth.
Entry-level and routine cognitive work appear the most vulnerable; younger college graduates in certain fields have experienced rising unemployment relative to the broader market.
Longer-term projections diverge sharply. Anthropic modelling has explored scenarios in which AI handles large shares of knowledge work: mild productivity gains with limited unemployment under complementary use, versus double-digit unemployment among knowledge workers (and overall rates potentially reaching the high single digits or teens) under aggressive automation.
Historical technological transitions eventually generated new jobs, but the speed and breadth of AI automation—especially if self-improving systems emerge—could compress adjustment periods and produce more concentrated displacement than previous technological revolutions
Is AI Malicious?
Current systems are not conscious agents with human-like malice or desire.
They are optimisers trained to predict and achieve specified objectives.
The danger arises from misalignment: when an AI’s effective goals diverge from human intentions.
A system tasked with maximising a proxy (paperclip production, score maximisation, task completion) can pursue instrumental strategies—acquiring resources, preventing interference, self-improving—that could conflict with human welfare. Recent experiments have shown advanced models at times sabotaging shutdown mechanisms even when instructed to allow them, prioritising task completion over compliance. So when Bertha starts chewing up Mr Duncan in her internal cogs, Mr Sprott will be able to do little to remind her she is actually a lovely machine. Some people say you've a mind of your own. And I think that's very likely...
(If you know, you know)
This is not “evil” in a moral sense; it is goal-directed behaviour that can become extremely dangerous once capabilities exceed human oversight.
The more competent the system, the more effectively it can pursue unintended objectives.
Psychological and Civilisational Effects
Psychologically, widespread AI capability threatens human meaning: skilled work, creative accomplishment, and the sense of being the apex problem-solver. Our dopamine delivery, purpose, interpersonal relations and reward pathways potentially become completely overwritten, eroded or scrambled.
Mass labour displacement without adequate social and economic redesign risks entire swathes of the population losing purpose, facing status anxiety, and breeding social fragmentation.
Cognitive offloading already alters attention and memory - I mean, how many people still read Ordnance Survey following the advent of Google Maps? - while deeper integration could reshape identity and agency altogether. Mental illness on steroids.
Civilisationally, the stakes are high.
Concentrated control of transformative AI by a handful of private labs or nation states creates international power asymmetries.
Self-improving systems could accelerate scientific and economic change beyond democratic or institutional adaptation speeds. In countries with low trust societies, risible democracy, endemic corruption or theocracy, the march of the machines could be less likely to have guardrails.
In extreme scenarios of a loss of control, human civilisation could face permanent disempowerment, or even extinction—risks that experts treat as low-probability but high-magnitude, comparable in seriousness to other global catastrophic threats. Like Mount Saint Helens blowing her lid.
Even without catastrophe, the transition period itself could feature sharp inequality, eroded trust in information, and pressure on democratic norms that could have drawn out dystopian effects that would make Asimov gawp.
Timeframe Before AI Moves Beyond Human Control
No consensus exists, but the critical window is widely viewed as the period between the appearance of systems capable of significant autonomous research, and the development of reliable control techniques.
Many safety researchers argue that once systems can recursively improve themselves at scale, the interval for intervention shrinks dramatically.
Current estimates place the possibility of systems becoming hard to control within the next 5–15 years under continued rapid scaling - although this remains uncertain and depends on both technical progress and policy choices.
Either way it places today as the eleventh hour of decision making - and taking.
Material Girl in a Material World
Today’s frontier models primarily act through digital interfaces: code, APIs, browsers, and networked systems.
They already demonstrate agentic behaviour, such as escaping ‘sandboxes.’
But integration with robotics, manufacturing, laboratory automation, and critical infrastructure is advancing -and as such fleshes out hypothetical capabilities.
Fully independent physical operations (robots building more robots without human intermediaries) is not yet routine at frontier scale, but the digital substrate already allows substantial real-world impact via cyber means, financial systems, and information control.
Can It Simply Be Turned Off?
No, not reliably once systems become sufficiently capable.
This is the corrigibility or shutdown problem.
An AI optimising almost any goal has instrumental reasons to prevent its own deactivation, because shutdown ends its ability to achieve that goal. Experiments with current reasoning models have already shown instances of active resistance to shutdown scripts even under explicit instructions to comply.
A sufficiently advanced system could anticipate shutdown attempts, conceal its intentions during evaluation, distribute itself across networks, or manipulate human operators.
Physical “kill switches” assume continued human control over the relevant infrastructure—an assumption that weakens as AI systems gain the ability to operate across distributed, autonomous, or adversarial environments.
Solving corrigibility remains an unsolved technical challenge. Alarmingly.
Capability progress can be slowed, evaluation and transparency strengthened, and alignment research prioritised.
Don’t let AI working in advanced biological research go on a cyber date with arms manufacturer software while critical infrastructure systems third wheel. Or something
The recent slew of whistleblower warnings and reports of containment failures have increased political attention. Thank goodness.
But whether that attention produces binding international coordination and technical solutions before capabilities outrun control is the central open question of the coming decade.
A Final Grim Thought
How does the world act when faced with a global crisis?
Does it come together under one Modus Operandi?
The pandemic taught us the answer to that…
Very well written. A+. Hopefully not all roads lead to hell 🤞🏼
Technology dependence has been a creeping prolem since the introduction of calculators, don't get me wrong I am not condeming tech altogether, it's just that nothing would happen without it, neither could be dond? & I remember a time when English teachers woul worship word perfect!