Comment by astrange

Sakana AI is also working on merging different transformer models together to combine skills.

https://sakana.ai/evolutionary-model-merge/