Comment by semiquaver
9 hours ago
> many industries that don't trust machine generated code in general.
Which ones? Why wouldn’t careful human code review and extensive test coverage suffice? I work in one of the most conservative and highly regulated industries in the country. My company and every single one of my peer companies I have knowledge of has transitioned to almost exclusively 100% LLM-generated code (with plenty of human review).
I don’t live on a coast and I have a large and broad social network. I don’t know anyone who still mostly codes by hand except the small amount needed to preserve some aspect of their skills. I’m sorry to say that if I did I’d consider them foolish. Even a very restrictive workflow where you used an LLM to specify granular edits you intend to make is vastly faster than doing it by hand. And the level of test coverage and depth you can achieve now is simply life-changing.
It’s much more likely that you are not a professional, or you are the one in a bubble.
>Why wouldn’t careful human code review and extensive test coverage suffice?
I have come to understand that LLM generated code, even when carefully reviewed, ends up being hard to review as time progress.
This is because when you are coding yourselves, you get a first hand sense of the complexity creeping in. Then you refactor some stuff to keep complexity in check. LLMs does not "feel" such friction, and will happily keep adding on complexity until meaningful reviews are impossible beyond a certain point.
At this point, you need an LLM to review the changes and at that point, all bets are off.
This is a very good point. So many times I would refactor entire parts of the code base just because it’s getting too complicated and an easier solution was possible. AI is do often just let’s drill down all these variables, whatever
> Which ones?
Any that value correctness over speed. Banking, safety critical embedded work, aerospace work, etc.
> Why wouldn’t careful human code review and extensive test coverage suffice?
Because anyone who has been in the industry for a while knows that code review is not a substitute for intentionality and understanding when writing the code. To properly validate a change you must fully understand the intention behind it and the design at play, and then check the changes made against the system design. That is best done by a human subject matter expert (this is the role which software developers have traditionally filled, for anyone new to the industry).
> I work in one of the most conservative and highly regulated industries in the country. My company and every single one of my peer companies I have knowledge of has transitioned to almost exclusively 100% LLM-generated code (with plenty of human review).
That's called "being in a bubble".
> I don’t live on a coast and I have a large and broad social network. I don’t know anyone who still mostly codes by hand except the small amount needed to preserve some aspect of their skills. I’m sorry to say that if I did I’d consider them foolish.
And I think it's foolish to let your coding and critical thinking skills atrophy like this, but you do you.
> It’s much more likely that you are not a professional, or you are the one in a bubble.
Not even worth a reply.
I’m perfectly willing to consider the possibility that you may be right, but “a bubble” implies something massive outside of it which constitutes a large majority of the whole, and that’s simply not the case here. I just don’t believe there are more than a small handful of companies like you describe. It’s not like these things aren’t extensively studied, and all the industry surveys I’ve seen point in the direction of more and more LLM-assistance in coding worldwide.
I have connections in most of the industries you named and I can promise you that they are no different. I don’t particularly care whether you believe me, but I encourage you to self-examine to understand whether what you are saying is what you would like to be true (I do too!) or whether it actually is.
> I have connections in most of the industries you named and I can promise you that they are no different. I don’t particularly care whether you believe me, but I encourage you to self-examine to understand whether what you are saying is what you would like to be true (I do too!) or whether it actually is.
You are literally talking with a professional developer who is telling you that they don't use LLMs to write their code and that they have connections who also continue to do this work manually.
I don't particularly care whether you believe me either, but I encourage you to take a look around - your initial claim that coding has been automated across the industry is incorrect and you seem to be in denial about that for some reason. You should question where your priors are coming from, and remember that just because your circle is comprised of people who are heavily using LLMs does not mean the entire industry is that way.
1 reply →
So no one is in control at the wheel? Just press a button?
I can see in the future in school or on the job. Oral testing is coming back. You’re gonna have to explain everything you are doing at some point to your teacher/boss or to a panel of your peers in detail.