← Back to context

Comment by buzzin__

14 hours ago

Or some randomness is aomehowntroduced in the output, which happens after every word, unless you set the temperature to zero.

3 comments

buzzin__

Reply
reliablereason  13 hours ago

That would not be intuition that is just randomness. Intuition is not randomness.

A jump in intuition comes from automatic processes reorganising the relational structure of conceptual models. There is no reorganisation of the model durring inference.

  • tpolm  12 hours ago

    > There is no reorganisation of the model durring inference.

    one could argue that model can reorganize / interact with prior knowledge captured in text form (edit files) hence there can be reorganisation