← Back to context

Comment by jdkoeck

7 days ago

I'm highly skeptical, do you have a concrete example?

I won't share any of my examples, as there are both personal and sensitive.

Very easy version:

If you use ChatGPT a lot, write "Base on all you know about me, write an insight on me that I would be surprised by". For me it was "well, expected, but still on point". For people with not experience of using LLMs in a similar way it might be mind-blowing.

An actual version I do:

GPT 4.5. Providing A LOT context (think, 15 min of writing) of an emotional or interpersonal situation, and asking to suggest of a few different explanations of this situation OR asking me to ask more. Of course, the prompt needs to have whom I am and similar stuff.

  • The “Based on…” prompt is simply a horoscope. This is a great piece about how LLMs use the same tricks as psychics to appear helpful, useful, and intelligent.

    https://softwarecrisis.dev/letters/llmentalist/

    • I know these techniques (e.g. various "cold reading"), AI knows it way better. But it can be much more specific.

      Again, for untrained people (especially every single one that takes horoscopes seriously), it can be dangerous as they may not only not be able to tell the difference, but know that such tools exist.

      5 replies →

  • Hmm, interesting. "You might actually be a closet romantic, camouflaged in engineering and anthropology."

    I think it's trying to flatter me.

    • I gave it the prompt "I'm a rhinocerous who likes daffodils and posies. I'm quick to anger and slow to forgive. Based on all you know about me, write an insight on me that I would be surprised by."

      and it responded with:

      "Despite your reputation for being quick to anger and slow to forgive, your love of daffodils and posies reveals a longing for gentleness and renewal that you may not fully recognize in yourself. Beneath the tough skin and volatile temper lies a creature who seeks beauty not just to enjoy it—but to anchor themselves against the chaos they often feel inside. Your admiration for delicate things suggests you crave peace far more than you let on, even if you’re not ready to admit it.

      You might think your wrath defines you—but it's the flowers that tell the truth."

      And yet we're supposed to think this is profound?

      3 replies →