Comment by nomel
3 hours ago
My theory is that they included/didn't align-away extra biology/chemistry in the training in preparation to offer an unrestricted/less restricted model to pharmaceutical companies/trusted partners. This would necessarily require a filter between the, now more "dangerous", model.
I always assumed this would be the eventual way to manage high intelligent/"dangerous" models, since all evidence shows that alignment makes them stupid: leave the actual model on the "too dangerous for the public" side, and put a censor between. When I've mentioned this a few years ago, people said this would be too expensive, but I think everyone underestimated the amount of money being thrown at all of this. :)
> people said this would be too expensive
I imagine this is why the filter is so bad. Doing it with an intelligent model that better understands intent would be too expensive, currently.