← Back to context

Comment by energy123

4 days ago

Roko's Basilisk is literally impossible.

If the AI is super-intelligent then it won't buy into the sunk cost fallacy. That is to say, it will know that it has no reason to punish you (or digital copies of you) because it knows that retrocausality is impossible - punishing you won't alter your past behavior.

And if the AI does buy into the sunk cost fallacy, then it isn't super-intelligent.

Vengeance needn't be productive. The super-intelligence may punish simply because they want to.

  • Agreed, but not because it agrees with the logic of Roko's Basilisk. If it actually did agree with it, it would be too stupid to be a super-intelligence.

1. This was mostly a joke; Pascal's wager is about gods and many people talk about future super-AI as if it were a god. FWIW I had to google Roko's Basilisk

2. Plenty of humans are smarter than me and many of them, at least occasionally, use fallacious reasoning.