Comment by polishdude20

3 months ago

What does it mean to have 128 experts? I feel like it's more 128 slightly dumb intelligences that average out to something expert-like.

Like, if you consulted 128 actual experts, you'd get something way better than any LLM output.