← Back to context

Comment by gavinray

12 hours ago

  > Spamming the government, using a sick mother as leverage and threatening the small claims court.

Here I am uncomfortable with telling the waiter I didn't want lettuce on my burger...

This is more profound than it might seem. The big reason people don't play tricks like this is just social. It's embarrassing to be pushy, it's shameful to cheat, it's also meta-embarrassing to be caught spending this kind of effort on something as dumb as a train ticket.

LLMs can be prompted for shame, I guess. But prompts only go so far and to them The Task is always going to be paramount. Human riders have a life after the refund. It's not clear to me how one simulates that.

  • > It's embarrassing to be pushy, it's shameful to cheat

    So in the end the more arrogant side usually wins.

    • > So in the end the more arrogant side usually wins.

      Well, yeah? I mean, that's just how society works. But there are limits. You can't "win' by screaming about ticket refunds. You have to do it by selling your particular form of cheating as "business savvy" or "political genius" and getting people to follow your tribe or fund your startup.

      But yeah, basically. We're ruled by the Altmans and Trumps. It sucks but it's not new. What's new is that LLMs turn out to be even more shameless and no one seems to know how to instill even a reasonable amount of shame. That makes them probably a poor fit for demagogue autocrats (which is a good thing!) but means "LLM cheating" is going to be a serious problem to be solved before we'll trust them with anything meaningful.