Comment by ceejayoz
6 months ago
> OpenAI publishes IP ranges for their bots...
If blocking them becomes standard practice, how long do you think it'd be before they started employing third-party crawling contractors to get data sets?
6 months ago
> OpenAI publishes IP ranges for their bots...
If blocking them becomes standard practice, how long do you think it'd be before they started employing third-party crawling contractors to get data sets?
Maybe they want sites to block them that don't want to be crawled since it probably saves them a lawsuit down the road.