Comment by subscribed

I mean if the model is intended to be deployed somewhere for some purpose by some business, as a business you probably would not want to worry whether users may use to produce sth that could be seen as embarrassing or problematic pr-wise. Having a sanitized and more directed training set can help with that. MS does not produce only 7B models, and 7B models can still say "embarrassing" things. I may be wrong of course.