What Is Existential Risk?

Question

What is existential risk, and why has a term coined in the 2000s become one of the most important concepts of contemporary ethics? The question arises because the technologies of the twenty-first century — advanced artificial intelligence, genetic engineering, and the continuing existence of nuclear arsenals — have made it possible, for the first time in history, for human beings to destroy their own future. The concept of existential risk is the attempt to think clearly about this possibility.

Quick Answer

Existential risk is the risk of an event that would destroy humanity's future potential — either by killing everyone (extinction) or by causing a collapse from which humanity could never recover. Nick Bostrom's definition is standard: "an existential risk is one where an adverse outcome would either annihilate Earth-originating intelligent life or permanently and drastically curtail its potential." The main sources of existential risk are: advanced artificial intelligence that is not aligned with human values; engineered pandemics from biotechnology; nuclear war; and severe environmental collapse. The field of existential risk studies has three tasks: estimating the probability of these risks, understanding how they interact, and finding ways to reduce them. The moral framework that motivates the field, longtermism, holds that because the future of humanity could be astronomically large, the protection of that future should be one of our highest priorities.

Historical Wisdom

The awareness that humanity could destroy itself is modern but not new. The development of nuclear weapons in 1945 made extinction a technical possibility, and the philosophers and scientists who built the bomb — and the generations after them — have wrestled with the responsibility it created. Hannah Arendt, reflecting on the atomic age, argued that the capacity to destroy the world changed the human condition: for the first time, the future of the species was in human hands. The Cold War gave the world its first large-scale reflection on human extinction, and the "nuclear ethics" debates of the 1980s — deterrence, just war, the ethics of mutually assured destruction — were the first systematic attempts to think about planetary risk. What the contemporary field of existential risk adds is scope and method: the recognition that nuclear weapons are only one of several ways humanity could lose its future, and that the others — AI, biotechnology, environmental collapse — require the same seriousness.

Philosophical Perspectives

The philosophy of existential risk has three central debates. The first concerns probability: how likely are these risks? The estimates vary enormously, from near-zero to substantial. The debate is difficult because existential risks are unprecedented — there is no historical frequency to measure — and because the sources are accelerating: the risk from AI, for example, depends on when and whether advanced AI is built, which is itself a choice. The disagreement is not merely technical but philosophical: it concerns how to reason about the unprecedented, and how much uncertainty should motivate action.

The second debate concerns the value of the future. Longtermism argues that the future could be enormously valuable — if humanity survives, it could flourish for billions of years, and the number of future lives at stake dwarfs the number of lives today. On this view, reducing existential risk is morally paramount, because it is the condition of everything else. Critics of longtermism argue that it neglects present suffering, that the astronomical future is too uncertain to ground action, and that a focus on far-future risk can distract from the urgent needs of the present. The debate between longtermism and its critics is one of the defining disputes of contemporary ethics.

The third debate concerns action. What should be done about existential risks? The answers range from technical research (AI alignment, pandemic preparedness, arms control) to institutional reform (new governance structures for risky technologies) to cultural change (a shift in how humanity thinks about its own future). The debate is shaped by uncertainty about which risks are most urgent, by disagreement about the effectiveness of interventions, and by the difficulty of coordinating action on a global scale. What unites the field is the conviction that the question can no longer be ignored: the risk of losing the future is now a subject of rational study, not science fiction.

Lessons From Thinkers

The existential risk literature yields several lessons. From Bostrom: the difference between a catastrophe and an existential catastrophe is the difference between a wound and a death — recovery is possible from one, not the other, and this difference justifies treating existential risk as a category of its own. From Toby Ord's The Precipice: humanity is at a moment of unique fragility — the "precipice" of its history — and the choices made in the coming decades may determine the entire future of the species. From the longtermists: the number of future lives at stake makes the reduction of existential risk a moral priority that present-focused ethics has failed to register. And from the critics: risk reduction must not become an excuse for neglecting present injustice — the two commitments are not competitors but companions.

Practical Application

Existential risk has become a field with practical consequences. AI safety research — alignment, interpretability, robustness — is funded and conducted in response to the perceived risk from advanced AI. Biosecurity programs work to reduce the risk of engineered pandemics. Arms control and nuclear risk reduction remain urgent. And a growing governance literature addresses the regulation of powerful technologies before they are deployed at scale. The practical lesson is that existential risk is not a speculative topic: the institutions, research programs, and policy debates that address it are already shaping the future of technology. The philosophical contribution is to keep the question of value central: what is the future worth, and what are we willing to do to protect it?

Quotes

Bostrom's definition is the founding statement of the field: "An existential risk is one where an adverse outcome would either annihilate Earth-originating intelligent life or permanently and drastically curtail its potential." Toby Ord states the urgency in The Precipice: "Humanity's future is at a precipice — a moment of unprecedented risk and opportunity, where the choices we make may determine the very long-term fate of our species." And the moral core of the field is captured in the observation that "the future is not guaranteed; it is a choice."

Related Questions

• What Is the Alignment Problem? — the AI risk that motivates much of the field.
• What Is Transhumanism? — the vision of a technologically transformed human future.
• What Is Nihilism? — the philosophical counterpart to the belief that the future matters.
• What Is Meaning in Life? — why the survival of meaning-making creatures matters.