Powered by OpenAIRE graph
Found an issue? Give us feedback
addClaim

The AGI Race and Existential Risk

Authors: Ethan Bueno de Mesquita; Wioletta Dziuda; Mattias Polborn;

The AGI Race and Existential Risk

Abstract

Concerns about the race to artificial general intelligence often assume that competition and resources increase risk by accelerating development. We study a model in which firms allocate scarce resources between speed and safety. Speed increases a firm's chance of reaching AGI first but leaves fewer resources for safety; safety lowers doom risk but slows arrival. Fragmentation increases total speed and conditional doom risk by shifting a fixed industry resource pool toward speed. The model also identifies a critical market size: below it, firms have positive expected payoff from achieving AGI, while above it, firms race even though achieving AGI has negative expected value. More per-firm resources always accelerate expected arrival, but their effect on conditional doom risk changes sign at this cutoff. Policy affects risk by changing equilibrium incentives: consolidation, resource regulation, commitment devices, and cautious public entry can improve welfare in some environments. The results show that AGI risk depends not only on technical considerations, but also on market structure, resource constraints, and institutions that shape the equilibrium allocation between speed and safety.

  • BIP!
    Impact byBIP!
    selected citations
    These citations are derived from selected sources.
    This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    0
    popularity
    This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
    Average
    influence
    This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    Average
    impulse
    This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
    Average
Powered by OpenAIRE graph
Found an issue? Give us feedback
selected citations
These citations are derived from selected sources.
This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Citations provided by BIP!
popularity
This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
BIP!Popularity provided by BIP!
influence
This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Influence provided by BIP!
impulse
This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
BIP!Impulse provided by BIP!
0
Average
Average
Average
Upload OA version
Are you the author of this publication? Upload your Open Access version to Zenodo!
It’s fast and easy, just two clicks!