← Back to context

Comment by skippyfish

2 days ago

Can you share your experiment, so that we can draw our own conclusions? I've been paying for Pangram for a long time and have not seen it misbehave even once. I've seen many people attack it, but when I looked more closely, their claims often evidently boiled down to "I want plausible deniability for my own use of LLMs" - i.e., they were clearly posting AI-generated content on social media and just didn't like the possibility of being called out.

I'm not saying that's you, but since a proof is easy to produce, it would be nice if you could share.

12 comments

skippyfish

Reply
amrit3128  2 days ago

I think most native English speakers are doing well. The one who will face issues are non native ones. I knew English as my third language since about 10 years but I've only truly become somewhat proficient in it in the past 5 or so years, thus it was heavily influenced by LLMs. So who's at fault for this? Me, for speaking like an LLM simply due to my circumstances? Am I now supposed to learn "human" english?

  • coldtea  2 days ago

    From what I've seen and read it regularly flags native English writing as AI too. Sometimes even changing a few words is enough for it to change the verdict.

    It's not command of the english language it flags (for native vs non native to matter), it's stylistic mannerisms, some of which happen to also exist in some direct translation of some foreign patterns for some languages.

    But it detects them in a crude manner, missing obvious AI slop, and misflagging human texts.

ano-ther  2 days ago

I‘ve seen reports of markdown-tags (##) flipping a pangram result from human to machine (with human written text).

But I don’t have a license to confirm.

coldtea  2 days ago

>I've been paying for Pangram for a long time and have not seen it misbehave even once.

How would you know if you just take whatever slop verdict is serves as correct?

phoghed  2 days ago

Read the OP you goofball, there’s examples right there in it.

  • skippyfish  2 days ago

    I'm asking the parent about their claim. I already have an opinion about the parent post, in which the author is claiming to have not used an LLM to author a 2025 essay that's illustrated with completely unnecessary AI art. Although one doesn't imply the other, let's say that this diminishes my willingness to believe that claim at face value.

  • zahlman  2 days ago

    https://news.ycombinator.com/newsguidelines.html

    > Be kind. Don't be snarky. Converse curiously; don't cross-examine. Edit out swipes.

    > When disagreeing, please reply to the argument instead of calling names. "That is idiotic; 1 + 1 is 2, not 3" can be shortened to "1 + 1 is 2, not 3."

    > Please don't comment on whether someone read an article. "Did you even read the article? It mentions that" can be shortened to "The article mentions that".