Comment by areweai
21 hours ago
That acronym is unacceptable. It's going to impede discussion and cause confusion for a long time if it doesn't die off immediately.
21 hours ago
That acronym is unacceptable. It's going to impede discussion and cause confusion for a long time if it doesn't die off immediately.
You think that's bad? I introduce you to LION, (evoLved sIgn mOmeNtum) [1]
[1] https://arxiv.org/pdf/2302.06675
Now I just hear the Voltron intro riff in my head
Those flying diecast lions hurt when they hit you as a kid
not bad although archived. have any info why?
We're still talking about "zero-shot prompt" when the saying "X-shotted" ["One-shotted the difficult maze"] was already a well-established thing in daily vernacular. So now you constantly have to readjust your brain because whenever you read "zero-shot prompt" your mind goes "uh.. a zero-try attempt is a paradox and cannot exist".
Zero-shot, one-shot, few-shot etc. refers to how many examples you have to give.
It comes about from machine learning algorithms that could pick up on patterns from a small number of examples. Few shot means only a handful of examples to recognize something. One shot means only a single example. And zero shot means no examples. Of course, you have to indicate what you want somehow, but in the case of an LLM that's the prompt. Once LLMs were trained for instruction following, you didn't have to give any examples, you could just give a prompt describing what you want, and that was a zero-shot.
You're explaining something to me I already know. Hence the "readjust my brain".
I'm complaining about the LLM field co-opting a term that was already used in daily vernacular. Imagine if people in the LLM field made it so that saying the LLM made a "final answer" means that it got stuck in a loop. Now, whenever someone says an LLM gave a "final answer" we have to divine if they meant it is in a loop or gave the right answer after working through a few intermittent ones by itself.
Choosing to call it "X-shot" was a dumb move. And now we're stuck with it. No two ways about it.
> a zero-try attempt is a paradox and cannot exist
Have you tried applying L'Hôpital's Rule?
Zero shotting: there wasn't even an attempt.
Minus one shotting: you have to make one attempt for there to have been no attempt, and two attempts for there to have been one attempt.
You miss 100% of the shots you don't take
- Wayne Gretzky
1 reply →
confusing indeed. I wondered "which RAM? nvram? dram? vram? dram? now what's g-ram?"
GPU RAM, clearly. At least that's where my mind went.
Pretty sure it's "GNU Is Not Unix Rapid Access Memory", actually
1 reply →
We already have VRAM for that purpose, thankfully.
It's great if they also introduce KILOGRAM
Yeah, look what happened to GNU
Is this the right place to do everyone's favorite copypasta?:D
It's just an acronym. It's not gonna impede anything. Think of it as just a name - you either know what it refers to or you don't, you don't understand something from it's name, or it's acronym.
It's an acronym that matches an extremely common word, making it not easily searchable.
Like countless others. You just add a second term for context.