Comment by bombcar
11 hours ago
Wayback machine removes archives upon request, so there’s definitely stuff they don’t make publicly available (they may still have it).
11 hours ago
Wayback machine removes archives upon request, so there’s definitely stuff they don’t make publicly available (they may still have it).
You don't even need to do requests if you are the owner of the URL. Robot.txt changes are applied in retrospect, which means you can disallow crawls to /abc, request a re-crawl, and all snapshots from the past which match this new rule will be removed.