← Back to context

Comment by jasondigitized

5 hours ago

This. I feel like folks are living in two separate worlds. You need to narrow the aperture and take the LLm through discrete steps. Are people just saying it doesn't work because they are pointing it at 1m loc monoliths and trying to oneshot a giant epic?

AI was useless for me on a refactor of a repo 20k loc even after I gave examples of the migrations I wanted in commits.

It would correctly modify a single method. I would ask it to repeat for next and it would fail.

The code that our contractors are submitting is trash and very high loc. When you inspect it you can see that unit tests are testing nothing of value.

   when(mock.method(foo)).thenReturn(bar)
   assert(bar == bar)

stuff like that

its all fake coverage, for fake tests, for fake OKRs

what are people actually getting done? I've sat next to our top evangelist for 30 minutes pair programming and he just fought the tool saying something was wrong with the db while showing off some UI I dont care about.

like that seems to be the real issue to me. i never bother wasting time with UI and just write a tool to get something done. but people seem impressed that AI did some shitty data binding to a data model that cant do anything, but its pretty.

it feels weird being an avowed singularitarian but adamant that these tools suck now.

I'm using Claude in a giant Rust monorepo. It's really good at implementing HTTP handlers and threaded workers when I point it at prior examples.