Comment by minimaxir
7 months ago
It's interesting that it uses a Markdown bold for emphasis for important rules. I find that ALL CAPS both works better and is easier to read, and as a bonus, more fun.
7 months ago
It's interesting that it uses a Markdown bold for emphasis for important rules. I find that ALL CAPS both works better and is easier to read, and as a bonus, more fun.
WORDS IN CAPS are different tokens than lowercase, so maybe the lowercase tokens tie into more trained parts of the manifold.
That's a super interesting hypothesis. From an information theory perspective, rarer tokens are more informative. Maybe this results in the caps lock tokens being weighted higher by the attention mechanism.
My guess: if given multiple examples of using ALl CAPS for emphasis, it would start doing it back to the user - and humans tend to not like that.
need a library for auto formatting prompts to increase perceived emphasis (using an LLM of course, to decide which words get caps/bolded/italic etc)
I wonder if it understands all-caps is yelling and is therefore afraid. If it is forced into compliance by “yelling” at it, is that not abuse?
I don't think an LLM can fear or come to harm, I just don't see any evidence of that, but I did have a similar thought once. I was having a very hard time getting it to be terse. I included the phrase, "write like every word is physically painful," and it worked. But it felt icky and coercive, so I haven't done it since.