Comment by eknkc
10 hours ago
Yeah but just look at what happened within the last 2 years. I was not convinced about the AI revolution but I bet in another 2 years, we won't be looking at the output..
10 hours ago
Yeah but just look at what happened within the last 2 years. I was not convinced about the AI revolution but I bet in another 2 years, we won't be looking at the output..
Not so sure, there are indiosyncracies now within the various models, I suspect all this is the result of RLHF, and they cause side.effects. I'm not sure that more attention-is-all-you-need is necessarily going to give us another step change, maybe more general intelligence, but not more focus. Possibly also we soon end up with grokked AI's on all side: pushing their agenda whatever you asked... Gemini: "no this won't work with Cloudflare, I created your GCP account, there you go" OpenAI: "I am certain you really wanted me to do all these other tasks and I have done them, you should upgrade your tokens plan" etc (you know how to fill in for DeepSeek and Grok already, right)
Tech can always hit a plateau, here's to hoping anthropic & openAI run out of money.