← Back to context

Comment by ndriscoll

13 hours ago

I'm saying the client can take the action, but the user never sees the client because they interact with it through e.g. their AdBuster box, a glorified PiKVM that interacts with client, OCRs it, and produces simple filtered HTML for the user.

As long as you can attach a display and USB inputs, your "monitor" or "braille device" can go straight to a vision model, which can then send inputs from your "keyboard". There are already off the shelf devices that can do this if you install an agent harness.

Like an ad blocking DVR for the 2020s.

6 comments

ndriscoll

Reply
cobbzilla  13 hours ago

Whose DD API key is being used? This is not an anonymous access scenario. The DD API client is tied to some company, the behavior is detectable, they are banned.

Or do you give out KVMs to all your customers and say “place your DD orders with us this way”?

  • gruez  12 hours ago

    He's saying that some AI agent (with computer use capabilities, which the recent gpt model is supposedly good at) can at the very least, operate a browser (or phone) of the doordash website/app, scrape the contents via OCR, present them to the user, then relay any actions back to the website, all via KVM, making all of this undetectable to the site.

  • nvme0n1p1  9 hours ago

    > the behavior is detectable, they are banned

    How will DD detect that I put a sticky note on my screen at the spot where ads are displayed?

    How will DD detect if a robot is operating the touchscreen or a human finger?

    • cobbzilla  1 hour ago

      Ships passing in the night. I’m not disagreeing with any of this, and yall still miss the point.

      I understand that individuals can make purchases with the DD API. People who want to buy things without seeing ads can always do that. Very few people will do that.

      I’m referring to the obvious B2B2C use case where a company embeds DD functionality via the API. Then you’d have to teach the trick to everyone who uses your app or service and that’s not practical. If you skip at the server it’s trivially detectable.

matheusmoreira  12 hours ago

> As long as you can attach a display and USB inputs, your "monitor" or "braille device" can go straight to a vision model, which can then send inputs from your "keyboard".

This is awesome!!

The local AI revolution is going to be glorious. It's no wonder they want to regulate this shit.

I can't wait until uBlock Origin integrates AI support.