← Back to context

Comment by ethin

3 hours ago

The fundamental problem with even the kind of mitigation you suggest is that it just doesn't work. You would need to build some kind of completely dynamic authorization system that could figure out the context of user-provided instructions and limit agent access based on that context, at least I think. I've said it before and I'll say it again: I don't think this is actually solvable. This isn't like SQL injections or similar where the grammar was fixed and there was a predefined set of possible inputs. Here the set of inputs is unbounded as long as natural language is the medium of expression.