Comment by Mickelby

It's hard to over-estimate the "crawled but not currently indexed" apocalypse that's happening at the moment.

Google is DRASTICALLY reducing the size of their search index. The reasons can be debated but the outcome is clear. A much smaller index of pages they consider to be the primary authority. Anything else they are not interested in and do not need.