should be pretty easy to test and not rely on an anonymous source from a weird analytics company via business insider. are these bots actually from openai or are they just using their user agent? are they coming from openai ip ranges? etc. https://openai.com/gptbot.json
should be pretty easy to test and not rely on an anonymous source from a weird analytics company via business insider. are these bots actually from openai or are they just using their user agent? are they coming from openai ip ranges? etc. https://openai.com/gptbot.json
> should be pretty easy to test
I look forward to your results, whether or not they disprove the article.
Are all of OpenAI’s ip ranges known?
The article is from 2024. Is this still happening?
Do we have any evidence they started complying?
If not, we can conclude they did not, until such evidence shows up.
I’m genuinely curious to know whether there was a change in behavior especially after OpenAI informed about how to prevent scraping (robot.txt, etc.).
1 reply →