Well, you can always ask it to predict a next bit in the code. Or even a letter. Maybe combine multiple letter into one and call it a token. We'll give a name to a procedure that gets tokens - decode. To improve speed, we can predict multiple tokens speculatively. To improve quality we'll give it extra space to store Chain of Thought. Ah, wait, we just invented LLMs
My bad, maybe I read it wrong or the comment was edited, but I was referring to LLMs in general. You won't get a fair coin flip from the model either way.
Jev literally cannot write programs.
Well, you can always ask it to predict a next bit in the code. Or even a letter. Maybe combine multiple letter into one and call it a token. We'll give a name to a procedure that gets tokens - decode. To improve speed, we can predict multiple tokens speculatively. To improve quality we'll give it extra space to store Chain of Thought. Ah, wait, we just invented LLMs
My bad, maybe I read it wrong or the comment was edited, but I was referring to LLMs in general. You won't get a fair coin flip from the model either way.
Found the human in the comments section.
this is not what *decision models* do.