← Back to context

Comment by bendmorris

6 hours ago

Sounds like you violated the clearly stated project rules and admitted to it. Are you surprised that they're not engaging with you?

Reading their comment it sounds like they wanted to confirm the bug existed with AI, not sure they ever said they had AI write the code. Why have such a dumb policy?

It's a violation of project rules to confirm bugs with AI?

Pointing out something that is not good doesn't require surprise at the fact that it happened

Yeah, the maintainers of a DOA hobby project should certainly be allowed to run it however they want imo

  • That's honestly my biggest problem with Zig.

    It's clearly a hobby project (constant breakages, the maintainer getting into politics, rejecting some safety mechanisms, the anti-LLM crusade, a strange focus on esoteric targets with little to no commercial significance), but the maintainer does not admit that it is a hobby project.

    It makes me respect the Rust community even more.

Wow I thought surely they wouldn't object to using AI to confirm bugs, but they really do.

Tbf I guess as a popular open source project not using AI to fix bugs, they probably already have more open bugs than they can ever fix so it doesn't really help them for people to find more.

I would imagine his bug was actually ignored just because Zig has 2700 open bugs, rather than some AI policy violation.

  • They don’t, at least not any more. Andrew Kelley has explicitly stated that he sees the value of using LLMs to uncover bugs. Inspired by sqllite project.

    https://youtu.be/zwi5b5xSsKA?is=PTjJJjSnVMdRuZag

    They may just be taking the slow route of rejecting by default until they can be sure that the usage of LLMs provides long term value. I don’t see anything wrong with that. If you’re writing robust software, using LLMs at this stage is a bit of a gamble. We don’t fully know the long term effects on code quality yet.

    • He sees the value of using LLMs... only after performing NASA-level verification and fully comprehensive fuzzing using traditional tools. Since Zig has not done those things, LLM-generated bugs are still banned.

  • The popular LLM projects have infinitely many more bugs than the zig project does this is a ridiculous message.