AI Safety Compendium

Near-Term Harms vs. Long-Term X-Risk

6 min read

Near-Term Harms vs. Long-Term X-Risk

One of the hardest strategic tensions in ai-safety is not technical but philosophical and political: should the field’s attention, funding, and regulatory priority go toward documented present-day harms from AI systems (bias, labor exploitation, misinformation, surveillance) or toward speculative long-term catastrophic and existential risks (ai-takeover-scenarios, deceptive-alignment, stable-totalitarianism)?

The two camps are often called “AI ethics” (near-term) and “AI safety” or “AI x-risk” (long-term). They share concerns but disagree sharply on framing, priority, and method.

The Near-Term Harms Position

Present-day AI systems already cause documented harm:

  • Algorithmic bias in hiring, lending, criminal justice, facial recognition
  • Labor exploitation of data labelers and RLHF workers, often in the Global South
  • Misinformation and deepfakes eroding information ecosystems
  • Mass surveillance enabled by computer vision and large-scale pattern recognition
  • Job displacement and labor market disruption
  • Environmental costs of training large models
  • Concentration of corporate and state power in the hands of AI infrastructure owners
  • Discrimination against marginalized groups at scale

The ethicist’s critique of x-risk framing:

  • X-risk arguments rest on speculative future scenarios, not observed failures.
  • Attention to distant hypothetical catastrophes distracts from material harms happening now.
  • Many x-risk proponents are affiliated with the labs building the systems they claim are dangerous — a conflict of interest.
  • The demographic composition of the x-risk community (overwhelmingly Western, male, EA-adjacent) shapes which risks it finds salient.

The Long-Term X-Risk Position

longtermism, cause-prioritization, and existential-risk frameworks argue:

  • Expected value: even low-probability extinction-level outcomes dominate moral calculus because the stakes include all future generations.
  • Irreversibility: most near-term harms are painful but correctable; extinction and value-lock-in are not.
  • Tractability window: the period before transformative-ai is the only period in which alignment can be solved; present harms can be addressed later.
  • Convergence: many x-risk interventions (interpretability, capability-evaluations, ai-governance) also reduce near-term harms.

The x-risk critique of pure ethics framing:

  • If catastrophic scenarios materialize, ordinary harm frameworks become irrelevant.
  • The AI ethics field has not engaged seriously with capability trajectories that suggest systems may soon exceed human control.
  • scaling-laws and intelligence-explosion dynamics mean the timeline for action may be shorter than ethics-focused work assumes.

Why the Tension Is Hard

1. Resource allocation is zero-sum

Research funding, regulatory attention, and skilled talent are finite. Every dollar on algorithmic audit infrastructure is a dollar not on scalable-oversight research. Every regulatory cycle spent on near-term harms is a cycle not spent on frontier model evaluations.

2. Epistemic standards differ

Near-term harms are documented in peer-reviewed empirical studies with identifiable victims. X-risk arguments rest on chains of reasoning about systems that don’t yet exist. ben-garfinkel has argued from within the x-risk community that many classic arguments (ai-risk-arguments) don’t meet the epistemic standard the community would demand of other fields.

3. Policy structures diverge

Regulation for near-term harms fits existing frameworks (anti-discrimination, labor, consumer protection). Regulation for frontier model risks requires novel institutions (responsible-scaling-policy, capability-evaluations regimes, international coordination). The EU AI Act covers both but leans near-term; proposed US frameworks lean frontier.

4. Political coalitions differ

Near-term harms create coalitions with civil rights organizations, labor unions, marginalized communities, and academics from critical theory traditions. X-risk creates coalitions with EA funders, anthropic-style labs, defense/national-security interests, and academic philosophers. These coalitions rarely overlap and sometimes actively distrust each other.

5. The “TESCREAL” critique

Ethicists like Timnit Gebru and Émile Torres have argued that the x-risk community shares intellectual DNA with transhumanism, extropianism, singularitarianism, cosmism, rationalism, effective altruism, and longtermism (“TESCREAL”) — and that this cluster encodes ideological assumptions that shape which futures are imagined as threatening or desirable. X-risk proponents generally reject this framing as a genetic fallacy but acknowledge it reflects real demographic and cultural patterns.

Where the Tension Dissolves

Several mechanisms narrow the gap:

  • ai-governance as common ground: many regulatory mechanisms — transparency requirements, incident reporting, audit rights, liability regimes — address both kinds of risk.
  • information-security (nova-dassarma): protecting model weights benefits both near-term (preventing misuse) and long-term (preventing uncontrolled proliferation of dangerous capabilities).
  • interpretability serves both camps: understanding model decisions addresses bias (near-term) and alignment verification (long-term).
  • Labor and safety convergence: the same frontier labs that present x-risk concerns also exhibit near-term labor and environmental issues; reform campaigns can target both.
  • ben-garfinkel’s bridge position: improving epistemic standards within the x-risk community narrows the methodological gap with the ethics community.

Where It Does Not Dissolve

  • Prioritization under tight resources: when forced to choose, the two camps choose differently.
  • Speed vs. thoroughness in regulation: near-term harms want enforceable rules now; frontier risk wants deployment gates tied to evaluations that may slow rollout.
  • Who gets the microphone: representation in AI policy debates remains contested; both camps see themselves as under-represented relative to the other.
  • Career guidance: 80000-hours prioritizes x-risk-focused paths based on cause-prioritization logic; ethics-focused paths lead through different institutions and credential systems.

Empirical Evidence on the Zero-Sum Assumption

The most common version of the near-term case — the “Distraction Argument” — claims x-risk discourse actively diverts attention and resources from near-term harms. A 2025 academic paper (Swoboda, Uuk et al., 2501.04064v1) rigorously evaluates this claim and finds it “largely unsupported”:

  • AI ethics attention (measured by Google search trends and funding for AI ethics organizations) has grown or remained steady alongside growing x-risk attention (Grunewald 2023)
  • Recent legislation explicitly addresses near-term harms: California’s deepfake bills, Biden’s AI Executive Order covering bias, fraud, and job displacement
  • Governor Newsom vetoed a frontier AI safety bill (SB 1047) while signing near-term harm bills — the opposite of what the Distraction Argument predicts
  • Corporate suppression of safety risk discussion (OpenAI whistleblower NDAs) suggests companies restrict all harm discussion, not leverage x-risk as a smokescreen

This evidence suggests the tension between near-term and long-term AI concerns may be less zero-sum in practice than either camp’s rhetoric implies. The two forms of attention appear to co-evolve rather than trade off.

How This Wiki Sits

The wiki’s source base leans heavily x-risk and longtermist: 80000-hours, the 11 podcast episodes with AI safety researchers, Situational Awareness, AI 2027, the nick-bostrom/toby-ord/will-macaskill corpus. This is an accurate reflection of the source material, not a claim that near-term harms are less important.

A balanced view of the tension requires reading outside this wiki’s corpus — Timnit Gebru, Meredith Whittaker, Emily Bender, Kate Crawford, the DAIR Institute, the AI Now Institute. The absence of these voices here is a gap worth acknowledging.

Sources cited

Primary URLs harvested from this page’s summary references. Auto-generated by scripts/backfill_citations.py; edit by re-running, not by hand.

Graph View

Graph view

The interactive citation graph is desktop-only. Visit this page on a larger screen to explore how concepts, agendas, papers, and organisations link together.

Backlinks