Comment by iraqmtpizza
1 year ago
LLMs don't have neurons. That's just marketing lol.
"A neuron in a neural network typically evaluates a sequence of tokens in one go, considering them as a whole input." -- ChatGPT
You could consider an RTX 4090 to be one neuron too.
It’s almost as if ‘neuron’ has a different meaning in computer science than biology.
LOL you just owned the guy who said "LLMs with a much smaller number of neurons than the brain are in many cases producing human-level output"