Comment by quantumHazer

Exactly. Also related on why Natural Language is not really good for programming[0]

[0]: https://www.cs.utexas.edu/~EWD/transcriptions/EWD06xx/EWD667...

Anyway I indeed find LLMs useful for stackoverflow-like programming questions. But this seems to not be true for long as SO is dying and updated data on this type of questions will shrink I think.