Comment by scottyah
15 hours ago
Do you really think a random person off the street knows more about how LLMs work internally than the latest frontier model (that has been trained on that material)?
15 hours ago
Do you really think a random person off the street knows more about how LLMs work internally than the latest frontier model (that has been trained on that material)?
No, but a random person off the street also isn't making skills for LLMs.
I think that LLMs are trained on the millions of vibe written LLM blog posts that are more superstition than fact. There is a lot of snake oil out there that is treated as fact. If someone claims that an LLM is better than humans at something I always want to see the rigorous evaluations that have been done to quantify it, not "but they're trained on everything!"