Comment by faraaz98
3 months ago
I've been calling for this approach for a while. It's kinda similar to how the human brain has areas that are good at specific tasks
3 months ago
I've been calling for this approach for a while. It's kinda similar to how the human brain has areas that are good at specific tasks
It's already used a lot — the paper I believe is from 1991, and GPT4 among many others is MoE