← Back to context

Comment by parliament32

6 months ago

Didn't even have to click through to the report in question to know it would be all hallucinations -- both the original patchfile and the segfault ("ngtcp2_http3_handle_priority_frame".. "There is no function named like this in current ngtcp2 or nghttp3.") I guess these guys don't bother to verify, they just blast out AI slop and hope one of them hits?

12 comments

parliament32

Reply
indigodaddy  6 months ago

Reminds me of when some LLM (might have been Deepseek) told me I could add wasm_mode=True in my FastHTML python code which would allow me to compile it to WebAssembly, when of course there is no such feature in FastHTML. This was even when I had provided it full llms-ctx.txt

  • alabastervlog  6 months ago

    I had Google's in-search "AI" invent a command line switch that would have been very helpful... if it existed. Complete with usage caveats and warnings!

    This was like two weeks ago. These things suck.

    • j_w  6 months ago

      My favorite is when their in search "AI answer" hallucinates on the Golang standard lib. Always makes me happy to see.

      1 reply →

    • sidewndr46  6 months ago

      Isn't there a website that builds git man pages this way? By just stringing together random concepts into sentences that seem vaguely like something Git would implement. I thought it was silly and potentially harmful the first time I saw it. Apparently, it may have just been ahead of the curve.

      1 reply →

    • bigiain  6 months ago

      <conspiracy theory> Google's internal version of that tool _does_ implement that command line switch...

spiffyk  6 months ago

> I guess these guys don't bother to verify, they just blast out AI slop and hope one of them hits?

Yes. Unfortunately, some companies seem to pay out the bug bounty without even verifying that the report is actually valid. This can be seen on the "reporter"'s profile: https://hackerone.com/evilginx