← Back to context

Comment by Disposal8433

3 days ago

Avoiding captchas and disrespecting robots.txt. How does it feel to advertise your spam service? Are you proud?

6 comments

Disposal8433

Reply
ogandreakiro  2 days ago

Hey- we built Notte for legitimate workflows like testing and approved automation; not abuse. Like other session provider tools (Browserbase, Hyperbrowser, Anchor, etc.), we encourage respecting site terms and robots.txt, and we’re adding built-in support for it soon to enforce this policy inside Notte.

  • xena  2 days ago

    You should also support Web Bot Auth and make it required to have a customer-specific abuse contact in the user-agent header so that people can send invoices to those customers for when your customers cause downtime due to excessive scraping.

    • ogandreakiro  2 days ago

      Yes, that’s a very good point! We’ll look into this for SDK usage. What do you recommend for the public repo where it's harder to enforce runtime headers?

      1 reply →