Comment by 0xDEAFBEAD
8 hours ago
>Using domain specific models for critical things like healthcare is probably the worst thing you can do. There's this stupid notion that you can just lean into AI slightly without committing and you can pay 10% and get 10% of capabilities - like just for healthcare, just for agriculture. That's not how it works.
What's your evidence for this claim?
Wrote about it here https://simianwords.bearblog.dev/why-domain-specific-llms-wo...
In short: there’s a reason OpenAI doesn’t have health care model, chemistry model, mathematics model etc. If they want a smaller model they nerf all domains together like in GPT nano. Why? It’s because intelligence compounds and if you take away capability of mathematics from a model, you remove capabilities in all dimensions.
So basically you r saying diversity matters
Interesting though ..