Comment by torben-friis

>We're still at the beginning of figuring out what these tools even are, let alone how best to use them.

That's a fair point, and I imagine it's going to take a long while for the dust to clear.

People are operating on semi-dark private implementations, where the approach that works today breaks tomorrow. It's like SEO, where people operate on assumptions of google's algorithm that are not provable or guaranteed to hold, so everything gets cargo culty.

Openai, anthropic et all are not fully to blame for this, I think. even if they wanted to be more transparent, it's hard to imagine what kind of determinism they could provide users with, since the product is a probabilistic emergent property more than purposeful design.

Then there's a flood of marketing and astroturfing that seeps into technical discussions, in a way that the engineering world is not really used to (other than the crypto space, that was relatively contained).

It's a really hard, multifaceted and interesting problem to solve. I just wish I saw more cold headed attempts to approach these issues scientifically.