← Back to context

Comment by tayo42

6 hours ago

Ai can work through all of those questions in number 2 and design around it.

I was just doing that yesterday designing a game demo lol

14 comments

tayo42

Reply
ben_w  5 hours ago

I have also tried developing games with them. I find them very weak at these things.

Often they can't figure out how to test the thing, so "does this attempted solution even work at all?" is its guess from reading the source code, and sometimes I've even caught them writing "tests" which are a regex on the source code, not functionality.

They know almost nothing about "is this solving the right problem?", they're trained to assume the user is right, not to frame-challenge.

My general experience both in game and non-game projects is that it will be lazy by default rather than solving things correctly. Sometimes I spot this from their responses, other times I only notice with manual testing.

matsemann  6 hours ago

Works for a demo, but quickly stagnates. Future models may of course push the limits further, but right now it quickly goes sideways without someone knowledgeable at the helm.

  • tayo42  6 hours ago

    You don't design things with never ending details though. If your developing a feature there's a limited scope to it. If your designing the direction of a large project you're working with higher level concepts.

    The point is that AI is aware of constraints and can manage a round it. You've got to keep in mind the size of a typical software project and plan. Most people aren't writing a kernel. They're writing some backend tool and need a project that fits into a couple of quarters with a handful of people at most involved.

    • addandsubtract  5 hours ago

      > The point is that AI is aware of constraints and can manage a round it.

      Only if you instruct it with constraints. Otherwise, it's happy to implement whatever workaround it needs. But it still takes a dev to know what those constraints are and why they're needed.

Madmallard  23 minutes ago

I meticulously described the netcode structure for my tactics game and it's simple enough to just send over on web sockets and fable was still giving me an endless hydra of sync issues