← Back to context

Comment by narmiouh

4 months ago

What did you use to determine this?

Ask because many of the online tools I've tried, they will sometimes tag what I've written at 30-40% AI written and sometimes purely AI written stuff is flagged as 60-70% AI

11 comments

narmiouh

Reply
tom_  4 months ago

"Quietly". Also, the first paragraph. If this wasn't actually 100% LLM generated, one has almost certainly been used to imbue it with the flavour.

  • gwern  4 months ago

    (That LLM rhetorical tic is especially funny because it's so obviously nonsensical in almost all contexts like OP - what would it mean for creatine supplementation's effects to not be 'quiet' and to be loud? The pills come with little Bluetooth speakers? You are trapped on the toilet for several hours a day with GI issues? The world suddenly takes on psychedelic colors and imagery all day long?)

relevant_stats  4 months ago

As of now there are only two somewhat reliable tools.

First one is Pangram. Other available detectors are varying level of bad, with some of them entirely shit (eg zerogpt something).

The second one is human mind. Read enough of that slop and your brain hopefully will start detecting AI patterns.

And this article is totally AI, both to Pangram, and to my mind.

  • vidarh  4 months ago

    My experience in testing actual AI written content on willing participants is that people are entirely useless at detecting AI written content with any reliability whatsoever.

    • relevant_stats  4 months ago

      I don't know what your experience is, according to mine there are some people who are better than chance at picking this up.

      And I believe my experience is something expected. People are also certain kind of a neural network. If an LLM system is trainable to be a decent detector, I don't see a reason why at least some people couldn't be.

      4 replies →

  • matwood  4 months ago

    > Read enough of that slop and your brain hopefully will start detecting AI patterns.

    Like those people last week who ripped on an actual Monet thinking it was AI generated? No, the human brain only thinks it can pick up what's AI.