Comment by kfk

At least in Enterprise IT, where I work, the challenge is not how you scale technology, but how you scale trust. Big IT problems are always trust problems. That messy CRM systems everyone complains about? The messiness is likely due to low organizational trust, departments working in silos, and disagreements on definitions (what is a customer?).

LLMs can scale technology, but they are terrible with scaling trust. You know what scales trust in Enterprise? Good leaders, good culture, good conversations, good meetings, good narratives, good insights, good decisions. Exactly the things that scaled trust 50 years ago, and exactly the things LLMs cannot directly impact.

But now see what is happening. Rather than doing the hard work of gaining trust and consent, employees are using LLMs to build their localized agents. Of course they are happy! But the Enterprise, as a whole, is not better off, the real problems have not been addressed, the consensus has not been reached.