Comment by grahamj

2 days ago

If you’re unable to throttle your own outgoing requests you shouldn’t be making any

I assume it'll be hard for them to notice because it's all coming from Azure IP ranges. OpenAI has very big credit card behind this Azure account so this vulnerability might only be limited by Azure capacity.

I noticed they switched their crawler to new IP ranges several times, but unfortunately Microsoft CERT / Azure security team didn't answer to my reports.

If this vulnerability is exploited, it hits your server with MANY requests per second, right from the hearts of Azure cloud.

  • Note I said outgoing, as in the crawlers should be throttling themselves

    • Sorry for misunderstanding your point.

      I agree it should be throttled. Maybe they don't need to throttle because they don't care about cost.

      Funny thing is that servers from AWS were trying to connect to my system when I played around with this - I assume OpenAI has not moved away from AWS yet.

      Also many different security scanners hitting my IP after every burst of incoming requests from the ChatGPT crawler Azure IP ranges. Quite interesting to see that there are some proper network admins out there.

      2 replies →