Comment by aesthesia

Unless the domain-specific training has significant negative effects on performance in other domains, I'm not sure there's a strong reason not to just train one model with all the capabilities. Maybe there's a monetization play here: release a generally capable model as open weights alongside specialized models that you only provide API access for.