Comment by KPGv2

7 days ago

I am the sole maintainer of a library that has so far only received PRs from humans, but I got a PR the other day from a human who used AI and missed a hallucination in their PR.

Thankfully, they were responsive. But I'm dreading the day that this becomes the norm.

This would've been an instant block from me if possible. Have never tried on Github before. Maybe these people are imagining a Roko's Basilisk situation and being obsequious as a precautionary measure, but the amount of time some responders spent to write their responses is wild.

I think most of it is them not having a way to know if the contribution was completely autonomous or directed by a human.

So they're defaulting to being as explanatory as possible because they don't want to give a rudely abrupt reply even if the poster is abusing AI

> got a PR the other day from a human who used AI and missed a hallucination in their PR.

Or "AI" is the cover used by a human for his bad work.

How do you know?

  • In this case, the person gave me a heads up they used AI. Basically "it might not be good quality bc I used an AI, sorry."

  • I'm actually quite positive about how commercial models would have difficulties to write messy code!

Was the contribution a net win in your view or was the effort to help the submitter get the PR correct not worth the time?