Comment by dofm
4 hours ago
I am equally cynical!
Some of it is cosmic ordering, some of it is cargo culting, some of it is clearly FUD.
The trick presumably is to end up on the words that actively shift the “culture” of the subsequent interpretation of words.
I don’t know how you do that, really, but I do think it’s extremely instructive to see what a model can do with an empty prompt.
If the explicit role-playing prompt is just to identify multi-valent terms, then revising the question to include more specific context without a role-play prompt should work just as well right? I’d be really interested if anyone has evaluated that hypothesis
A fun (frustrating) feature of language is that we get these name collisions even with a single domain. One that I have to remember to revise myself fairly often these days when chatting with other experts in my field is “diffusion model” which can either mean generative deep learning or a differential equation describing mass transport.
LoRA/LoRa always makes me chuckle. Feels like a turf war. And in the photography world, "AI model" is overloaded.
And indeed — beyond specific guidance around tool management, you have to wonder if a very minimal prompt and a /grill-me or /ubiquitous-language approach, narrowed to focus on what matters this time, wouldn't do better. I have been playing with this idea as I try to learn all this stuff in a local model context.