Comment by general1465
1 day ago
I am completely calm regarding AI and development.
First nobody sane want to give their domain IP to OpenAI/Anthropic. That's why local AI will eventually prevail and flourish because people who actually have some IP will have no problem to buy 10k+ EUR machine to run some pretty good models on it. However if your main job is just doing CRUD stuff, then you are screwed.
Secondly hallucination is really Achilles heel of every LLM. Sure you can recreate an application which exists in thousand of variations on the internet, but the moment you will try to go more into domain knowledge you will start struggling more and more.
Try to make CAN driver for ESP32, easy it is probably going to work. Try to make CAN driver for STM32F7xx now the AI will start having a problem but probably will be able to produce something what is working after a lot of debugging. Now let's make CAN driver for MPC5555. AI will start writing fairy tales about registers which do not exist. All of processor above have reference manuals and sometimes example git repositories available on open internet.
> First nobody sane want to give their domain IP to OpenAI/Anthropic.
Pretty much the whole industry has zero problem giving OpenAI/Anthropic full access to their systems and codebases.
You're putting way more thoughts into it than the vast majority, most companies seem to go with the momentum
> First nobody sane want to give their domain IP to OpenAI/Anthropic. That's why local AI will eventually prevail and flourish because people who actually have some IP will have no problem to buy 10k+ EUR machine to run some pretty good models on it. However if your main job is just doing CRUD stuff, then you are screwed
Replace OpenAI/Anthropic with AWS and this is not too dissimilar to the arguments in 2009 about cloud providers.
It’s not that there's nobody for whom this is true, it’s just that there’s enough of everyone else to build an empire with.
> It’s not that there's nobody for whom this is true, it’s just that there’s enough of everyone else to build an empire with.
But those everyone else are racing to the bottom because all their ideas are being soaked up by AI and then being given to their competitors on a silver platter as AI output.
This is untrue and a conspiracy theory. Enterprise deals have specific data retention and disclosure policies.
1 reply →
Did you try this by giving it access to the materials? Human programmers also don't memorize all this stuff. If this is the reason for your calmness it's quite shortsighted.
There are problems when you rely too much on AI generated code, but these shallow dismissals are quite annoying.
I did, the problem is that
1. There can be massive differences between chips which sounds plausibly same and thanks to the way how LLM is working, models are mangling these variations together
2. Registers are often named in very way similar across different manufacturers so models are making up registers in MPC5555 which are coincidentally registers in Renesas processors doing same thing.
3. There are no standard in reference manuals, sometimes there are literally missing chunks of knowledge thanks to translation to English or there are pieces which you can only get from Application Notes which has code as a screenshot.
And then you will find out that all those descriptions are wrong and through trial and error you will get it working in 2 weeks time.
Bonus point: Random people having public Git repositories for obscure processors, but with bad or completely non working implementation of drivers for them. However LLM will just output variation of this garbage on you, because there are 3 public repositories on the whole internet. Sometimes I have a feeling that this must be on purpose to poison the well.
Ok but it takes weeks of trial and error for expert humans. If you allow the llm to run the code and see the results and do trial and error, it will also likely figure it out, no?
2 replies →
> All of processor above have reference manuals and sometimes example git repositories available on open internet.
okay? then give those reference manuals and git repositories? I haven't heard something know LLMs can't get around and figure out?