Comment by jobigoud

LLMs can be very good at 2. Finding the best architecture, data structures, algorithms, looking on arXiv to see other ways to solve the problem, etc.

You have to work in design mode and stop it from pissing code. Describe the requirements as detailed as possible and refine them based on the responses. It's quite rewarding and helps structure the way you think about the problem.