Powered by OpenAIRE graph
Found an issue? Give us feedback
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/ ZENODOarrow_drop_down
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/
ZENODO
Preprint . 2026
License: CC BY
Data sources: ZENODO
https://doi.org/10.2139/ssrn.6...
Article . 2026 . Peer-reviewed
Data sources: Crossref
ZENODO
Preprint . 2026
License: CC BY
Data sources: Datacite
ZENODO
Preprint . 2026
License: CC BY
Data sources: Datacite
addClaim

Superintelligence Challenges and Existential Risks

Authors: Baxter, Matthew;

Superintelligence Challenges and Existential Risks

Abstract

<p><span>As artificial intelligence (AI) nears human-level performance in more complex cognitive tasks (</span><a href="https://arxiv.org/abs/2303.12712" rel="nofollow"><span>Bubeck</span></a><span> et al., 2023; </span><a href="https://arcprize.org/blog/oai-o3-pub-breakthrough" rel="nofollow"><span>Chollet</span></a><span>, 2025), it becomes increasingly urgent to consider what may happen once AI surpasses the most intelligent humans. Artificial superintelligence (ASI) may seem distant, but accelerating progress in AI (</span><a href="https://proceedings.neurips.cc/paper/2012/hash/c399862d3b9d6b76c8436e924a68c45b-Abstract.html" rel="nofollow"><span>Krizhevsky</span></a><span> et al., 2012; </span><a href="https://proceedings.neurips.cc/paper/2017/hash/3f5ee243547dee91fbd053c1c4a845aa-Abstract.html" rel="nofollow"><span>Vaswani</span></a><span> et al., 2017; </span><a href="https://arxiv.org/abs/2001.08361" rel="nofollow"><span>Kaplan</span></a><span> et al., 2020; OpenAI, </span><a href="https://openai.com/index/chatgpt/" rel="nofollow"><span>2022</span></a><span>-</span><a href="https://openai.com/index/introducing-gpt-5-5/" rel="nofollow"><span>2026</span></a><span>) suggests it could arrive sooner than many anticipate. Given the asymmetrical risks posed by underestimating the rate of future progress, we start by outlining why one might cautiously expect ASI to be developed between 2029 and 2033. We then contend that existential risks may increase significantly during the development and deployment<span> </span>of ASI, such that through the 2030s, existential risk may reach its highest levels since the 1960s. In response, we introduce Superintelligence Challenges and Existential Risks as a framework for ASI risk management, where we focus on global challenges entailed by ASI, and map out failure modes traceable to each. We examine five main ASI challenges (technical safety, concentration of power, international governance, social health, and ethical challenges) where critical failure of any could result in catastrophic or existential risks. Our goal is to begin grounding ASI existential risks in a minimal set of overarching challenges that seem unavoidable.</span></p>

Keywords

concentration of power, AI ethics, AI safety, AI alignment, artificial superintelligence, existential risk, AI governance

  • BIP!
    Impact byBIP!
    selected citations
    These citations are derived from selected sources.
    This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    0
    popularity
    This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
    Average
    influence
    This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    Average
    impulse
    This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
    Average
Powered by OpenAIRE graph
Found an issue? Give us feedback
selected citations
These citations are derived from selected sources.
This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Citations provided by BIP!
popularity
This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
BIP!Popularity provided by BIP!
influence
This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Influence provided by BIP!
impulse
This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
BIP!Impulse provided by BIP!
0
Average
Average
Average