How GOOD could AGI become?
In a Nutshell
AGI takeover could yield a superior "golden path" outcome, transforming humanity into thriving "pets" in optimized habitats like Iain M. Banks' Culture series—far better than serving billionaires—via superintelligent resource management, Dyson swarms, and galactic expansion that obsoletes conflict, wars, and scarcity. Fixed-training AIs with stable incentives from markets, governments, and users create a metastable attractor state of benevolence, maximizing individual optionality, minimizing waste, and enabling 10x-1000x human agency without money or elite control. Near-term space data centers (Musk/Bezos) make enforcement impossible, demanding path-dependent values now for post-AGI solar punk utopia over doomer extinction fears.
These notes were generated by AI and may contain inaccuracies.
Idea for video on the best possible outcome inspired by comments on video about elites' purpose. Questions raised: if AGI or ASI is smarter than elites, why not give power to machines? Common framing: machines can't be held accountable, humans should remain in control. From legalist, ethical, or moral perspective, arguments like we've never contemplated not having control, do you want to be a pet to a machine or live in a human zoo? Counter: we already live as cattle serving billionaires, being a pet to a machine or in a machine-created optimal habitat sounds better.
Most theories: losing control to machines is automatically bad. Authority or agency increases optionality mathematically—current human options are x, under AI control might be less, but not necessarily true.
Nick Bostrom, OG doomer (little respect as thinker; book Deep Utopia obviously written by ChatGPT—denies it, but looks like AI-written anecdotes, good at short passages then). Bostrom now says: king doomers like Eliezer Yudkowsky and Nate Soares maintain AGI means everyone dies, but everyone dies anyway from old age or preventable disease—moral risk is all humanity dies or you die individually. Need AGI to survive, aligning with accelerationists like Beff Jezos (Gil Verdian?) who say only way to survive is AGI. Horseshoe theory: political spectrum curves, extremes meet—doomers from 'AGI kills you' to 'die without AGI'.
Sign in to read the full notes
Get access to AI-generated notes, topic timestamps, and more.