Comment by bee_rider
3 days ago
You aren’t scraping for the sake of training a model, but scraping the prices and availability is still scraping, right?
I think some of the folks running sites would rather have you go to the site and view the items “suggested based on your shopping history” (I consider these ads, the vendors might disagree), etc.
I’m more sympathetic to the people running sites than the LLM training scrapers, but these are two parties in a many-party game and neither one is perfectly aligned with users.
> scraping the prices and availability is still scraping
Web browsing is scraping, too.
I am not doing anything that I myself wouldn't do, it would just take me longer. I'm not mass-scraping, training new models, etc etc. I'm just using a helper tool to do some work for me.
If you prevent that, you are effectively saying: humans have to perform the manual labor of clicking and browsing through our site, they are not allowed to be helped in any way. I don't think this is the right answer.