← Back to context

Comment by LPisGood

20 hours ago

Actually we can do classical theory of strategic interaction here. There will be a range of acceptable negotiated settlements to both parties since both parties have some estimate E of the expected balance of power resulting after a war. If A is the amount of surplus value Anthropic expects to lose in a war and H is expected amount of value humanity expects to lose in a war, the the range [max(E - H, E - A), min (E + H, E + A)] gives a whole continuum of mutually acceptable settlements.

Now there will be bargaining friction given that any power sharing agreement with Anthropic will likely increase their future capacity and thus the future expected balance of power, but maybe AI has a long enough utility horizon that we should all expect to be dead by the time it realizes the long-term expectation advantage