Comment by chrysoprace

At the expense of your privacy, potentially acting irrationally on your behalf, with the inherent weakness of being able to be prompt injected. All of that is not even to mention the grey area of who is responsible when your agent breaks the law.

These aren't hypothetical, and in the hands of non-technical users let alone technical users, they have are far too unpredictable.