Comment by avita1
2 years ago
Is this practically true? Yes, anyone can clone any repo from Github, but surely scraping all of Github would run into rate limits?
The terms and conditions say as much https://docs.github.com/en/site-policy/github-terms/github-t...
Well today you get to learn about the GitHub Archive project, which creates dumps of all GitHub data.
One example is the data hosted in Google Cloud.
https://cloud.google.com/blog/topics/public-datasets/github-...