Comment by jackomelon

Depending on the pre-training structure, you can fine-tune old local models (even locally if you have a nice GPU) to steer behavior towards your desires.

https://www.youtube.com/watch?v=yGkJj_4bjpE