← Back to context Comment by jacooper 3 days ago Actually synthetic training dats is better, thats why the new models are all better at design. 2 comments jacooper Reply jsheard 3 days ago If synthetic data is so much better then what are AI crawlers still DDOSing everyone for? Are they stupid? philipkglass 3 days ago Mostly. I had the "AI bot tsunami" problem on my own personal site and blocked a bunch of bot user agents in robots.txt. Most of them were from companies I had never heard of before. The only big AI name I recognized was GPTBot from OpenAI.
jsheard 3 days ago If synthetic data is so much better then what are AI crawlers still DDOSing everyone for? Are they stupid? philipkglass 3 days ago Mostly. I had the "AI bot tsunami" problem on my own personal site and blocked a bunch of bot user agents in robots.txt. Most of them were from companies I had never heard of before. The only big AI name I recognized was GPTBot from OpenAI.
philipkglass 3 days ago Mostly. I had the "AI bot tsunami" problem on my own personal site and blocked a bunch of bot user agents in robots.txt. Most of them were from companies I had never heard of before. The only big AI name I recognized was GPTBot from OpenAI.
If synthetic data is so much better then what are AI crawlers still DDOSing everyone for? Are they stupid?
Mostly. I had the "AI bot tsunami" problem on my own personal site and blocked a bunch of bot user agents in robots.txt. Most of them were from companies I had never heard of before. The only big AI name I recognized was GPTBot from OpenAI.