Comment by nly

7 hours ago

I keep giving the top Anthropic, Google and OpenAI models problems.

They come up with passable solutions and are good for getting juices flowing and giving you a start on a codebase, but they are far from building "entire software products" unless you really don't care about quality and attention to detail.

That is my experience too. I don't know what others are building but the more novel the task is the worse these models perform.