Comment by skybrian

One reason is that they might not have scraped it themselves, so if there was a ToS, it was someone else who broke it. For example, see:

https://en.wikipedia.org/wiki/The_Pile_(dataset)

Another reason is that if you can download a web page without agreeing to a ToS, I'm not sure that counts as one?