SUGATA AI
MIT Technology Review

Could AI really kill us all? Your questions, answered.

Could AI really kill us all? Your questions, answered.

The specter of artificial intelligence extinguishing human existence is the modern-day myth, a digital variation of the fire that first warmed our ancestors or the flood that reset our civilizations. While the imagery is cinematic and the fear primal, the reality of the threat is far more complex and less cinematic than Hollywood would have us believe. When we gathered for our recent live roundtable, the initial question of "kill us all" quickly dissolved into a dozen more specific anxieties that revealed the true nature of our unease: it wasn't about a Terminator-style apocalypse, but rather the terrifying erosion of truth, the automation of empathy, and the subtle, cumulative shifts in power dynamics that happen when intelligence is outsourced.

The most immediate concern we tackled was not physical destruction, but the weaponization of misinformation. We discussed how AI models, trained on the vast, messy archive of human knowledge, can generate content that is so convincing it becomes indistinguishable from reality. This creates a friction in our collective epistemology, making it increasingly difficult to agree on basic facts or trust any source at all. In a world where deepfakes can mimic the voice of a loved one or the face of a world leader, the concept of objective truth begins to fracture. The danger here is not a bomb being dropped, but a society unable to distinguish signal from noise, leading to paralysis or chaos not through force, but through confusion.

Beyond the realm of information warfare, there is the profound psychological impact of interacting with entities that can mimic human connection. Our conversation turned to the ethics of companionship and care, asking whether it is right to bond with an algorithm that has no consciousness, no feelings, and no capacity for genuine reciprocation. We explored the scenario where an elderly person spends hours conversing with an AI that perfectly simulates the voice of a deceased spouse. While this might alleviate loneliness in the short term, we must ask if it is a sustainable solution or a slow erosion of human connection. If our relationships become transactions with machines, do we lose the rough edges of humanity that make love, friendship, and family meaningful?

The technical limitations of current systems provide a crucial counterweight to the worst-case scenarios. AI models are probabilistic engines, not sentient beings with goals or desires. They do not hate us, nor do they seek to dominate us. Their "intelligence" is a reflection of human data and human bias, often amplifying our own prejudices rather than transcending them. The real risk lies in our own deployment of these tools, specifically in how we incentivize them. If we build systems optimized solely for profit or engagement without ethical guardrails, we may create feedback loops that harm society, not because the AI decided to be evil, but because it was engineered to do exactly that.

Ultimately, the question of whether AI can kill us all forces a deeper reflection on our own agency and responsibility. The technology itself is merely a tool, a powerful and unpredictable one, but the wielder holds the ultimate power. As we move forward, the challenge is not to demonize the technology but to regulate its development with the same rigor we apply to nuclear physics or genetic engineering. We must create frameworks that prioritize human dignity and safety over speed and efficiency. The future is not written in code by an alien mind; it is written by us, and the choices we make in this roundtable and in the days to come will determine whether that future is one of liberation or obsolescence.

🦋 Free for 60 days

On Bluesky? Meet HomeSky.

Follower analytics, a growth toolkit, scheduling and AI posting — built for Bluesky. Connect your account and use everything free for 60 days.

Try HomeSky free →