Comment by margorczynski
3 hours ago
Why do people assume what currently available is the ceiling, especially after the last 2-3 years of explosive growth?
Do you truly believe it won't get better, maybe even better at whole system design and implementation than people?
> Do you truly believe it won't get better, maybe even better at whole system design and implementation than people?
What are you calling "growth"? Adoption, or LLM progress? LLM progress has objectively slowed down, and for rather obvious reasons. The leaps from GPT-2 to GPT-4 can't be reprised forever.
It will get better, but the rate at which it does may not continue to be exponential. Past performance is not indicative of future results. While the agents models seem to continue to improve, I think LLMs as a whole have started seeing less and less benefits from the current scaling approaches.
I think what we currently have is pretty close to the ceiling for LLMs. But with the amount of money being spent there might be a new breakthrough (not llm)
It must depend on the person. I’ve been coding for all my life but have never been GOOD. I thoroughly enjoy coding, despite being frustrated many times.
Literally yesterday I remarked to my tech friends how fun coding with CoPilot is. I actually make forward progress now, and I understand all that the agent is doing.
For me, coding is an enjoyable means to an end. I do enjoy the process, but I enjoy the results more.
You could read the syntax and see what it logically did. But you likely don't always know why it did something, and you definitely don't know why another way wasn't chosen (maybe that way would have better aligned with your long term goals)
At least, they can still be much faster and cheaper.