“I want AI to be a tool that allows human flourishing!” exclaimed Brad Carson, a former member of Congress. “There is an option out there where AI is just a tool for us.”
The people who actually want AI to replace humanity
We need to create a new humanism before the “AI successionists” win.
Jun Cen for Vox
Sigal Samuel is a correspondent for Vox’s Future Perfect. She writes primarily about the future of consciousness, tracking advances in artificial intelligence and neuroscience and their staggering ethical implications. Before joining Vox, Sigal was the religion editor at the Atlantic.
This is a normal thing to say in most circles. But Carson was speaking at an invite-only symposium dedicated to the idea of creating a “Worthy Successor” — an AI so impressive, so beyond the mere human, that we’d actually want it to replace humanity.
“You’re a brave man for entering this room!” Dan Faggella, an AI market researcher and organizer of the symposium, told Carson. “You’re in probably the only room in the country where most people disagree with you.”
The attendees at the symposium, which took place at the New York Academy of Sciences last September, are part of a subculture that is growing in importance: the AI successionists, who think that artificial intelligence is our rightful heir — the next step in cosmic evolution. Since they believe AIs could become our moral superiors, they argue it’s actually wrong to try to keep the machines down, or even to align them with human values, as most AI companies aim to do. Instead, we should usher in artificial intelligence as a successor to humanity and hand over the world to it.
Become a Vox member
to continue reading.
