Self-Regulating Artificial General Intelligence / Joshua S. Gans.

Format:

Book

Author/Creator:

Gans, Joshua S.

Contributor:

National Bureau of Economic Research.

Series:

Working Paper Series (National Bureau of Economic Research) no. w24352.

NBER working paper series no. w24352

Language:

English

Physical Description:

1 online resource: illustrations (black and white);

Place of Publication:

Cambridge, Mass. National Bureau of Economic Research 2018.

Summary:

This paper examines the paperclip apocalypse concern for artificial general intelligence. This arises when a superintelligent AI with a simple goal (ie., producing paperclips) accumulates power so that all resources are devoted towards that goal and are unavailable for any other use. Conditions are provided under which a paper apocalypse can arise but the model also shows that, under certain architectures for recursive self-improvement of AIs, that a paperclip AI may refrain from allowing power capabilities to be developed. The reason is that such developments pose the same control problem for the AI as they do for humans (over AIs) and hence, threaten to deprive it of resources for its primary goal.

Notes:

Print version record

February 2018.