Comment by Gareth321
12 hours ago
> I'm not worried about the knowledge. I'm worried about the material conditions. These machines need compute and with that all sorts of inputs. I worry that the first to achieve such an abundance machine will use the abundance generated by it to monopolize control over these inputs.
I understand. I place less weight into this risk. The current AI supply chain is so globally interdependent that it has effectively distributed itself beyond centralised control. China has received the full weight of global chip sanctions and still somehow manages to provide competitive coding models using either grey imports, offshore cloud compute, or locally produced chips. It would be very difficult (and I would argue almost impossible) for a nation and especially an individual/company to seize ownership of the entire supply chain and prevent everyone else in the world from producing their own AI/chips/abundance machines.
> I think if we leave the transition to him and his peers, they will use it to build a system where they are untouchable god kings and the rest of us are paupers reduced to their charity.
No doubt many people in positions of power are megalomaniacs. This is why I place such emphasis on democracy. This allows the powerless to retain control of their nation and borders.
> This is why I place such emphasis on democracy. This allows the powerless to retain control of their nation and borders.
I think this is also a core part of our disagreement. I think if we allow privatized power structures to grow indefinitely, democracy will no longer be able to constrain them at some point, or they will subvert democracy itself by corrupting elected leadership.
You see both of these in action right now. Think of Elon Musk actively defying Brazilian rule of law [0] or him literally being put into a position where he can neuter the institutions designed to hold him democratically accountable with the DOGE appointment.
To quote MLK - "Call it democracy, or call it democratic socialism, but there must be a better distribution of wealth within this country for all God's children."
I think fundamentally one cannot disentangle democratic control of political power from democratic control of the economy, because economic power can be converted into political power and as long as we let economic power concentrate in the hands of a few unelected oligarchs, they will continue to use it to exert political power as well.
[0] https://www.reuters.com/technology/starlink-tells-brazil-reg...
> I think this is also a core part of our disagreement. I think if we allow privatized power structures to grow indefinitely, democracy will no longer be able to constrain them at some point, or they will subvert democracy itself by corrupting elected leadership.
I agree there is a risk, and I think defence of democracy should be at the forefront of fighting against the future you fear. I do not think the risk appears at the end of a gun. Rather, via propaganda and corruption. We know how effective propaganda can be, starting with Goebbels and all the way through to social media today. The problem here is that there is no clearly defined solution. Some people prescribe state control of information, which has historically resulted in catastrophic outcomes. Some people prescribe uncensored information to the greatest degree possible, and to the degree we have that today, it's also not working out very well. Perhaps this will be the great question of our time.
For the record, re DOGE, I see that as the people getting what they voted for. Musk campaigned clearly on his intended actions, and for better or worse, a plurality of voters voted for that. We should be careful not to criticise democracy just because voters chose a different direction. However I think this is partly influenced by what I describe above.