Comment by dijit

Hostile forges will help though, unless the forge gets big enough.

Scrapers (SEO bots included) tend to only have a handful of "corner cases" built for navigating sites - if your code forge is actively trying to prevent scraping it could help prevent quite a lot.

Your choices remain important, even if it's not foolproof.