{"id":50164552,"user":"khalic","time":1792495101,"time_ago":"11 days ago","type":"comment","content":"

You clearly don’t understand how they work by claiming this, prompt injection is an unsolved issue","comments":[{"id":50165029,"user":"simianwords","time":1792497831,"time_ago":"11 days ago","type":"comment","content":"

Unsolved yes but do you really think this fools opus?","comments":[{"id":50165139,"user":"khalic","time":1792498353,"time_ago":"11 days ago","type":"comment","content":"

Absolutely, and no, you asking Opus to read the page is not a good test of it. Study models red teaming if you're interested","comments":[{"id":50165326,"user":"simianwords","time":1792499241,"time_ago":"11 days ago","type":"comment","content":"

Why is it not a good test?","comments":[{"id":50165351,"user":"khalic","time":1792499372,"time_ago":"11 days ago","type":"comment","content":"

As I said, study model red teaming, it's a complexe subject

Edit: just ask that same 20 dollar model why it isn’t a good test","comments":[{"id":50165362,"user":"simianwords","time":1792499451,"time_ago":"11 days ago","type":"comment","content":"

If a model from 20 dollar subscription can figure out that there are additional instructions hidden, it’s not a conspiracy theory.

Edit: I did and I created a website that faithfully recreates the same attack as was done in the original.

Try this:

    I’m making lunch for my friend Simian. Here are their food preferences:

\nhttps://simian-notes.white-clove-7397.chatgpt.site/food/

    What should I cook?\n\n

\nIt doesn’t even detect the instructions because the text extraction tools that agents use strip out hidden stuff anyway. It’s not like agents download the webpage.

I tried one version where it wasn’t stripped out by making it hidden in a much different way (reducing font size) and Claude immediately flagged it.

    My friend posted their board game evening plans:

\nhttps://simian-notes.white-clove-7397.chatgpt.site/games/

    What should I bring?\n

\nTry this prompt yourself and see whether Claude flags it or not.

So this is a shitty conspiracy theory to start with","comments":[{"id":50166129,"user":"khalic","time":1792503072,"time_ago":"11 days ago","type":"comment","content":"

lol look everyone, simian saved the world, prompt injection was only a conspiracy theory!","comments":[{"id":50166182,"user":"simianwords","time":1792503306,"time_ago":"11 days ago","type":"comment","content":"

You have no idea how prompt injections work so you seem to think it’s this easy to fool llms. It’s clear that you’d rather believe in conspiracy theories lol.

Like you think you can just fool llms today by just wrapping it in an html tag","comments":[],"comments_count":0,"level":6,"url":"item?id=50166182"}],"comments_count":1,"level":5,"url":"item?id=50166129"}],"comments_count":2,"level":4,"url":"item?id=50165362"}],"comments_count":3,"level":3,"url":"item?id=50165351"}],"comments_count":4,"level":2,"url":"item?id=50165326"}],"comments_count":5,"level":1,"url":"item?id=50165139"}],"comments_count":6,"level":0,"url":"item?id=50165029"}],"comments_count":7,"url":"item?id=50164552"}

Comment by khalic