← Back to context

Comment by jubilanti

4 hours ago

Please don't do this. I know you mean well, but if you think you're providing a service here, you're not. This is not the same as posting an archive.today link to a paywalled article. This is not actually contributing anything to the discussion. Anyone who wants an LLM review can do so themselves. You have no idea if this is good output or slop. Nobody else knows if you even actually sent this through an LLM or not.

I trust them but it's immediately evident the instruction it gives to future bad actors: buy HN accounts, post false "security check passed" comments.

Is there a VirusTotal.com-but-LLM-analysis that folks could link to instead where we'd trust the prompts were sent and the responses were indeed received from the stated models? Hopefully run by someone with quite the budget and/or reputation.

Someone could come into this post and leave a comment saying they're a security researcher, that they audited the codebase, and include a summary of their findings. And that person could be lying.

I think saying that it contributes nothing because a) someone could do it themselves, b) the output might be slop, and/or c) they could be lying, is a bit silly. Those things apply to basically everything posted on the internet.

Whether an LLM security review is actually valuable is an entirely different discussion.

  • Sure, though I'd be more understanding of someone with little in the way of technical chops posting "here's my alleged LLM output" than someone saying "I'm a security researcher, looks great" when they've never linked any of their publications or anything. That's why I see this as a newer, slightly more dangerous spin on the old issue. (mitigation suggestion in my sibling comment)

Mythos alone proves the future of cybersecurity and software is agentic, and if you don’t believe that, run it back in 2 years when you are fired for someone who does..

+1 at least he cited his sources lol

Friend, you have upvote / downvote with which you can signal to a person the value of their comment. Pontification from a four month old account at that.. nah.