Comment by p2detar
5 hours ago
> I worked as a developer at a company. I asked the business owner a question about a business task. He sent me a ChatGPT screenshot with the answer. I replied that it had nothing to do with my question and everything there was wrong. A minute later he sent me another ChatGPT screenshot. He didn’t even read the AI’s answer.
That's just rude and borderline psychotic behavior.
It's still a bit better at my workplace but irritating nonetheless - my boss would "research" a feature and prep notes in our wiki with some gemini chatbot exchanges attached. This is a of course no specification, but it's supposed to be a good base point to start working on the feature. Gemini already chose the coding libraries and concepts, so to the outsider it just seems like all that's needed is to code that into the product. Of course, it's not that simple and it mostly gets in the way rather than help. But now questions arise why is the feature not ready yet, when "the plan" is already there and so obvious.
Just before LLMs became available to the general public, I worked for a small (fewer than ten employees) strategy consultancy. They had some industry-specific analysis tools that were in Excel, and my job was to turn them into a software product that customers could operate themselves. The owner had a mechanical engineering degree, but every time I asked him a technical question about the tools, he'd just give me a sales pitch for the thing I was trying to build for him. He was always pitching for new business, and seemed to struggle to get out of 'sales mode'. I have no doubt that if I were working for him now, he'd be pointing me to an LLM in response to any question.
This is why executives think LLMs can replace everyone. They can see it can replace them, and project that onto everyone else. And they don't see the gaps in knowledge because they don't care about the facts, only the presentation.
I have a theory that most people at most levels of work deal with the same amount of mental complexity. The difference is that as you move up the unit of abstraction gets larger, so your decisions and knowledge cover more scale. E.g. the engineer thinks about functions; the business owner thinks about products; the investor thinks about companies; the president thinks about nations; etc.
But people at the higher abstraction levels have a problem because they often never had (or lose) the ability to zoom in anywhere. And even the ones that can don't have time to learn to zoom in everywhere so they have to learn how to trust others, aka recognizing shibboleths. AI is great at sounding trustworthy and making reasonable looking output. In so doing, however, it's undermining the utility of shibboleths for large scale thinkers! That is the powerful are now deluding themselves that they have access to infinite reliable experts, and have gained the ability to zoom in everywhere, for only the cost of a data center. In a sense programmer experts like us are lucky because we have objective verification as a feedback loop to temper the exuberance. They do not.
If this is true, the kinds of error modes we'll see will be novel and catastrophic to a large fraction of businesses. If the feedback loops for correction are damaged or destroyed, we'll see firms gleefully, optimistically and energetically committing obvious mistakes until they die.
1 reply →
damn, this is a real zinger lol. Definitely seems this way.
Maybe unrelated but this memory pops up: I once worked with a mechanical engineer who could not visualize anything in his mind and had quite some trouble with word finding and explaining his ideas. He just couldn't say what needed to be built, he could only evaluate after it was built (often "argh, no not that").
It's as if his training had centered so much on 3d modeling and tangible tweaking as you go, that he hadn't learned to simulate anything with his thoughts before starting. He had to start building it to figure out what he meant. Incredibly creative person, out of the box thinker and big picture visionary, but with difficulty translating his ideas to verbal concrete steps. But nobody realized this, which resulted in a lot of frustration both ways:
"Why didn't you build what I said?" "I did. This is exactly what you said." "No it's not! I said x y z" "Yes you said x y z, this IS x y z" Silence. "Then that's not what I meant"
Now you know why AI text to CAD works so poorly.
Same, but not sure it's his training and just the way his head works. Have met a lot of people in software who can't draw or understand (very) simple block diagrams of systems. Some people don't have an inner eye.
Its so much worse now.
I deal with this all the time these days. If I ask for some clarification on scope, I usually get these ambiguous answers with fantastical ideas usually concerning some dreamed up impossible to implement tool that people assume is now possible because of AI, because everything is possible to them now!
There's an old computing maxim: GIGO. It used to mean "garbage in, garbage out" meaning that if you put garbage into a computer, then the output was garbage. Nowadays, GIGO means "garbage in, gospel out" meaning that no matter how bad the input was, the output was to be treated as The Word of God.
> That's just rude and borderline psychotic behavior.
With some notable exceptions, this describes almost every business owner I've worked with.
I use to get emails with some oddball questions slightly out of my field of expertise from business owners. I would answer, and they would forward my email to the person that asked them the question. They saw their role as routers.
>That's just rude and borderline psychotic behavior.
No, that's just disrespectful and entitled behavior from someone in power toward someone without power. I'm sure the person (business owner) felt pleased with themselves for saving so much time and mental effort in the interaction, with additional points for "authenticity" and "honesty" because they didn't hide the fact that they used an LLM. It damaged the relationship slightly but only time will tell if that was meaningful (and the harsh truth is that it probably isn't given the short lifespans of companies).
Maybe he was trying to say "look, when I can look this up, it means that you can too, i won't put any effort into it, because i pay you, but if i can use AI, so can you."
Maybe that was his rationale, "to educate" by example.
Absolutely nuts to treat employees this way, sending ChatGPT chats around.
The 'AI-generated pseudo-spec' is becoming a massive productivity killer. Non-technical managers prompt an LLM, get a highly confident 5-page document with chosen libraries, and think they've done 80% of the work. But as a developer, you now have to spend hours debugging and debunking hallucinated architectures just to prove why the AI's approach doesn't fit the existing codebase. It completely shifts the burden of actual product management into AI-babysitting for the dev team.
I was discussing a change we wanted to make to some tables in one of the DBs, but it would require a lot of effort because of the sheer size. Anyway, after saying how much effort would be required the response I got was to “please ask ChatGPT.” It gave a slightly different response, but changed it after I presented it with my solution and agreed that was the better approach. Just… sigh
You'd be surprised how many "scale-up"'s are owned by genuine idiots. I don't even mean inexperienced people, just people that - if you were to meet them for the first time - seem like they are fucking idiots. The type that recently figured out you can tie your shoe instead of tripping over them.
Those people own a yacht, a big house, all that stuff. I don't know how they do it. Is it incompetence, is it unwillingness? are they retarded? we'll never know...
>I don't know how they do it.
They are too dumb to not be confident. Plenty of confident dumb people are poor and try get rich quick schemes. Occasionally some of them work, and now you have a dumb business owner.
Yes.
If you're 10/10 smart, you're getting a 7 figure sign on bonus to go work at Meta as an AI researcher.
If you're 6-9/10 smart, you're probably miserable somewhere.
If you're 4-5/10 smart, you are one of these people.
6 replies →
so… they’re conmen
confidence man
Flowers for Algernon has something to say about this.
So Silicon Valley's big-head is based on an actual stereotype?
> psychotic
Probably more under-developed than psychotic.
ie not really using their adult thinking any more
I think psychotic fits. They have lost touch with reality, and are treating AI as some all knowing entity.
At my company, non technical Managers (including marketing folks) are posting Claude and ChatGPT responses in bug tickets with the "fix" for the bug. No explanation of what the expected vs actual behavior is, just AI slop telling me how to fix it. Soooo helpful.