Comment by wolttam
1 day ago
The LLM is mechanistically unable to pick something actually random and outside of its training distribution, so... yep.
1 day ago
The LLM is mechanistically unable to pick something actually random and outside of its training distribution, so... yep.
If you ask it to construct a UUID character by character you should get a somewhat random one, just because of temperature.
This actually worked well when I asked Gemini to generate a random color, character by character. I was getting Indigo/Electric Indigo a lot if I just asked for a random color on new sessions.
But all LLM output is token by token, which isn't too far from character by character in the case of a UUID. Why is this different? I do not know.