Comment by SXX

  > I wonder if there would be an equivalent of Non proliferation treaty like Nukes?

It work for nukes because production and scale needed is such that only state actor can do it. Obviously model training is getting expotentially more expensive, but its still nowhere as hard.

On top of this is just gonna be very hard to steal a nuke. So country cant just steal a nuke if they cant build one.

And even if some country do steal one nuke what of it? It really gives them nothing because they wont have parity for MAD.

Stealing model weight doesnt sound as complex though - once weights are out any small company can abliterate and run as many instances as they want.

Onbviously its not super simple, but certainly doable no matter how much effort LLM companies put into securing weights.