← Back to context

Comment by Waterluvian

19 hours ago

It must have been kind of incredible early on to be exploring this tech and you’re suddenly getting what look like sentences.

Markov chains give what look like sentences. People in the frigging 1950s assumed their primitive NNs would be able to talk any day now. Transformers are clearly a big deal, but GPT-1 wasn’t exactly earth-shattering.