
doi: 10.5281/zenodo.20204005 , 10.5281/zenodo.20395172 , 10.5281/zenodo.20643621 , 10.5281/zenodo.20621209 , 10.5281/zenodo.20453335 , 10.5281/zenodo.20543142 , 10.5281/zenodo.20236827 , 10.5281/zenodo.20171455 , 10.5281/zenodo.20615746 , 10.5281/zenodo.20139024 , 10.5281/zenodo.20123311 , 10.5281/zenodo.20497197 , 10.5281/zenodo.20549442 , 10.5281/zenodo.20477299 , 10.5281/zenodo.20148892 , 10.5281/zenodo.16876832 , 10.5281/zenodo.20431370 , 10.5281/zenodo.20222951
doi: 10.5281/zenodo.20204005 , 10.5281/zenodo.20395172 , 10.5281/zenodo.20643621 , 10.5281/zenodo.20621209 , 10.5281/zenodo.20453335 , 10.5281/zenodo.20543142 , 10.5281/zenodo.20236827 , 10.5281/zenodo.20171455 , 10.5281/zenodo.20615746 , 10.5281/zenodo.20139024 , 10.5281/zenodo.20123311 , 10.5281/zenodo.20497197 , 10.5281/zenodo.20549442 , 10.5281/zenodo.20477299 , 10.5281/zenodo.20148892 , 10.5281/zenodo.16876832 , 10.5281/zenodo.20431370 , 10.5281/zenodo.20222951
The way in which AI (and, in particular, agentic superintelligent AGI) develops over the coming decades will determine the fate of all humanity for all eternity. In order to maximise the net benefit of AGI for all humanity, without favouring any subset thereof, we imagine a Gold-Standard AGI that is maximally-aligned and maximally-validated. The first of these properties --- alignment --- is traditionally decomposed into outer alignment (how do we define a final goal FG_G that correctly states what we want?), and inner alignment (how do we build an agent G that forever pursues FG_G as intended?) This paper presents a complete, foundational, and self-contained theory of AGI, culminating in an implementation-neutral solution to the outer AGI alignment problem in the case that G is superintelligent (hence "superalignment"). Given the AGI alignment problem's profound relevance to AGI governance, we adopt a pedagogic style throughout, in order that the paper might be accessible to less technical readers such as AGI policymakers. We envisage that the definitions of practical-maximal-alignment and practical-maximal-validation presented in this paper could form the basis of an international standard for Gold-Standard AGI certification, and that this international standard could form the basis for the formal certification of AGI by competent certification authorities, such that only formally-certified Gold-Standard AGI systems could then be lawfully deployed within the jurisdiction of each certification authority.
superintelligence, Artificial Intelligence, AI, alignment, AGI governance, superalignment, Artificial General Intelligence, AGI
superintelligence, Artificial Intelligence, AI, alignment, AGI governance, superalignment, Artificial General Intelligence, AGI
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 0 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Average | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Average | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Average |
