Comment by dormento

My experience is that success with AI seems to be directly influenced by what technologies were employed. IA cannot learn further than its own context window when dealing with technologies it has not seen before (like an internally-developed framework). It does a good job on React, but it does a very poor job on a hand-rolled ORM.

For small greenfield stuff and throwaway code though, its generally very useful. For bigger projects, seems to be i tend to have more success with it mocking stuff, populating structures with test data and combing through logs to identify bottlenecks and opportunities for improvement when i've exhausted my tricks.