Comment by LoganDark

4 days ago

No harness is inherently secure or insecure based on its capabilities alone. Harness security, at least with regards to the model itself, has strictly to do with whether or not the model is allowed to take unauthorized action. If it is, the harness is insecure in that it enables the risk of unauthorized activity from the model. Otherwise, any particular harness may be insecure in other ways, but would not fundamentally be insecure in that way.

By this logic, a harness doesn't even have to be related to programming to be insecure. Any harness that enables unauthorized activity from the model would be insecure. For example, this would include any system that allows a model to make an unauthorized management decision.

As long as a harness can call shell, a prompt injection is inherently unavoidable.